Quick Start¶

This tutorials works on AWS / EC2, with region eu-west-1.

See the AWS / EC2 - Copy an AMI from a region to another if you want to change region.

Step 1: Get AWS credentials¶

Step 2: Create a security group¶

Step 3A: Run Scrapoxy with Docker¶

Run the container:

sudo docker run -e COMMANDER_PASSWORD='CHANGE_THIS_PASSWORD' \
    -e PROVIDERS_AWSEC2_ACCESSKEYID='YOUR ACCESS KEY ID' \
    -e PROVIDERS_AWSEC2_SECRETACCESSKEY='YOUR SECRET ACCESS KEY' \
    -it -p 8888:8888 -p 8889:8889 fabienvauchelles/scrapoxy

Warning

Replace PROVIDERS_AWSEC2_ACCESSKEYID and PROVIDERS_AWSEC2_SECRETACCESSKEY by your AWS credentials and parameters.

Step 3B: Run Scrapoxy without Docker¶

Install Node.js¶

See the Node Installation Manual.

The minimum required version is 4.2.1.

Install Scrapoxy from NPM¶

Install make:

sudo apt-get install build-essential

And Scrapoxy:

sudo npm install -g scrapoxy

Generate configuration¶

scrapoxy init conf.json

Edit configuration¶

Edit conf.json
In the commander section, replace password by a password of your choice
In the providers/awsec2 section, replace accessKeyId, secretAccessKey and region by your AWS credentials and parameters.

Start Scrapoxy¶

scrapoxy start conf.json -d

Step 4: Open Scrapoxy GUI¶

Scrapoxy GUI is reachable at http://localhost:8889

Step 5: Connect Scrapoxy to your scraper¶

Scrapoxy is reachable at http://localhost:8888

Step 6: Test Scrapoxy¶

Wait 3 minutes
Test Scrapoxy in a new terminal with:
```
scrapoxy test http://localhost:8888
```

Or with cURL:

curl --proxy http://127.0.0.1:8888 http://api.ipify.org