Secure Scrapoxy¶
Secure Scrapoxy with Basic auth¶
Scrapoxy supports standard HTTP Basic auth (RFC2617).
Step 1: Add username and password in configuration¶
Open conf.json and add auth section in proxy section (see Configure Scrapoxy):
{
"proxy": {
"auth": {
"username": "myuser",
"password": "mypassword"
}
}
}
Step 2: Add username and password to the scraper¶
Configure your scraper to use username and password:
The URL is: http://myuser:mypassword@localhost:8888
(replace myuser and mypassword with your credentials).
Step 3: Test credentials¶
Open a new terminal and test Scrapoxy without credentials:
scrapoxy test http://localhost:8888
It doesn’t work.
Now, test Scrapoxy with your credentials:
scrapoxy test http://myuser:mypassword@localhost:8888
(replace myuser and mypassword with your credentials).