PootisPenserHere/proxy_scraper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[add] Updated example with retries on 5xx errors

Browse Source
This commit is contained in:
Pablo Aramburo 2022-09-17 20:06:45 -06:00
parent 978c0ecd19
commit 7d9efbbe7d
1 changed files with 9 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
example.py
View File

@ -1,6 +1,13 @@
import requests import requests
from requests.adapters import HTTPAdapter, Retry
proxies = {'https': 'http://localhost:8080', 'http': 'http://localhost:8080'} proxies = {'https': 'http://localhost:8080', 'http': 'http://localhost:8080'}
ip = requests.get(url='http://canhasip.com/', proxies=proxies).text
print(ip) s = requests.Session()
retries = Retry(total=5, backoff_factor=1, status_forcelist=[ 502, 503, 504 ])
s.mount('http://', HTTPAdapter(max_retries=retries))
s.proxies = proxies
ip = s.get('http://canhasip.com/')
print(ip.text)