scrapy-rotating-proxies 0.6.2

Rotating proxies for Scrapy

Stars: 772, Watchers: 772, Forks: 158, Open Issues: 53

The TeamHG-Memex/scrapy-rotating-proxies repo was created 9 years ago and the last code push was 1 weeks ago.
The project is popular with 772 github stars!

How to Install scrapy-rotating-proxies

You can install scrapy-rotating-proxies using pip

pip install scrapy-rotating-proxies

or add it to a project with poetry

poetry add scrapy-rotating-proxies

Package Details

Author

Mikhail Korobov

License

MIT license

Homepage

https://github.com/TeamHG-Memex/scrapy-rotating-proxies

PyPi:

https://pypi.org/project/scrapy-rotating-proxies/

GitHub Repo:

https://github.com/TeamHG-Memex/scrapy-rotating-proxies

Classifiers

Related Packages

Errors

A list of common scrapy-rotating-proxies errors.

Code Examples

Here are some scrapy-rotating-proxies code examples and snippets.

GitHub Issues

The scrapy-rotating-proxies package has 53 open issues on GitHub

• Automation: Direction
• create START_HERE.md doc
• Global Revuew
• Is this how I cancel it?
• Allow Proxy Middleware Configuration for Specific Spiders
• Proxies are only differentiated by domain:port
• how to use proxy authentication username and password
• How to Update the proxy_list.
• it keeps checking my proxy servers Dead or not than actually doing its job of scraping data
• how to ban the proxy with timeout?
• Proxies working for longer time slows scraping down.
• Where is the settings.py? Should I create a new one for me?
• Read proxy list from an URL
• Is there a way to bypass the proxy check entirely? Everything Slowed
• Please add ability to not assign proxy that is in-use

See more issues on GitHub