pythonfix
scrapy-playwright 0.0.41
Playwright integration for Scrapy
Playwright integration for Scrapy
Stars: 996, Watchers: 996, Forks: 110, Open Issues: 21The scrapy-plugins/scrapy-playwright repo was created 3 years ago and the last code push was 1 months ago.
The project is popular with 996 github stars!
How to Install scrapy-playwright
You can install scrapy-playwright using pip
pip install scrapy-playwright
or add it to a project with poetry
poetry add scrapy-playwright
Package Details
- Author
- Eugenio Lacuesta
- License
- BSD
- Homepage
- https://github.com/scrapy-plugins/scrapy-playwright
- PyPi:
- https://pypi.org/project/scrapy-playwright/
- GitHub Repo:
- https://github.com/scrapy-plugins/scrapy-playwright
Classifiers
- Internet/WWW/HTTP
- Software Development/Libraries/Application Frameworks
- Software Development/Libraries/Python Modules
Related Packages
Errors
A list of common scrapy-playwright errors.
Code Examples
Here are some scrapy-playwright code examples and snippets.
GitHub Issues
The scrapy-playwright package has 21 open issues on GitHub
- RAM usage question
- Connection between timeout errors and concurrency level
- remote chrome support
- Close inactive contexts (experimental)
- Invoke page_init_callback after setting route
- Question about how to work with the Fetch that is generated when visiting a page
Related Packages & Articles
solverecaptchas 0.1.6
An asynchronized Python library to automate solving ReCAPTCHA v2
shot-scraper 1.5
A command-line utility for taking automated screenshots of websites
itemadapter 0.9.0
Common interface for data container classes
playwright-recaptcha 0.5.1
A library for solving reCAPTCHA v2 and v3 with Playwright
visual-regression-tracker 4.9.0
Open source, self hosted solution for visual testing and managing results of visual testing.
characterai 1.0.1
An unofficial API for Character AI for Python
botright 0.5.1
Botright, the most advance undetected, fingerprint-changing, captcha-solving, open-source automation framework. Build on Playwright, its as easy to use as it is to extend your code. Solving your Captchas for free with AI.
pydude 0.28.0
Dude (Uncomplicated Data Extraction) is a Python framework designed for crafting web scrapers with ease. This Flask-inspired framework facilitates the rapid creation of web scrapers with its intuitive syntax. While it's still in pre-alpha, Dude doesn't skimp on features. It supports multiple parser backends like BeautifulSoup4 and LXML, and offers functionalities like URL pattern matching and data grouping.
poium 1.6.2
Page Objects design pattern test library.