Official website (https://scrapy.org/)
Scrapy
Scrapy ( ) is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company.
Key facts
- Software.name
- Scrapy
- Software.logo
- File:Scrapy logo.jpg
- Software.developer
- Zyte (formerly Scrapinghub)
- Software.programming language
- Python
- Software.operating system
- Windows, macOS, Linux
- Software.genre
- Web crawler
- Software.license
- BSD License
via Wikipedia infobox
Official website
Scrapy — open source web scraping framework for Python
Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.
scrapy.org →Link to the official site · 6,101 chars · not written by Vinony
Described at
~1 min read
Article
2 sectionsContents
- History
- References
Scrapy ( ) is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company.
Scrapy project architecture is built around "spiders", which are self-contained crawlers that are given a set of instructions. Following the spirit of other don't repeat yourself frameworks, such as Django, it makes it easier to build and scale large crawling projects by allowing developers to reuse their code.