PootisPenserHere/proxy_scraper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6 Commits 1 Branch 0 Tags 186 KiB
Python 73.8%
Dockerfile 17.6%
Shell 8.6%
master
Go to file
Pablo Aramburo 02ef5e8de5 [add] Using validated proxies
2022-09-18 20:47:18 -06:00
.dockerignore [add] Forcing proxy refresh on container run 2022-09-17 19:57:58 -06:00
.gitignore [add] MVP 2022-09-16 15:35:23 -06:00
docker-compose.yml [add] Forcing proxy refresh on container run 2022-09-17 19:57:58 -06:00
Dockerfile [add] Forcing proxy refresh on container run 2022-09-17 19:57:58 -06:00
entrypoint.sh [add] Using validated proxies 2022-09-18 20:47:18 -06:00
example.py [add] Updated example with retries on 5xx errors 2022-09-17 20:06:45 -06:00
README.md [add] MVP 2022-09-16 15:35:23 -06:00
requirements.txt [add] MVP 2022-09-16 15:35:23 -06:00
scrape_proxies.py [add] More proxy sources 2022-09-16 18:24:09 -06:00

README.md

Proxy

Running the project

First create a list of live proxies

python3 scrape_proxies.py proxies.txt

Then run the mubeng instance through docker-compose

docker-compose up