Scrapy

Scrapy ( ) is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It is currently maintained by Zyte (formerly Scrapinghub), a web-scraping development and services company.

Key facts

Software.name: Scrapy
Software.logo: File:Scrapy logo.jpg
Software.developer: Zyte (formerly Scrapinghub)
Software.programming language: Python
Software.operating system: Windows, macOS, Linux
Software.genre: Web crawler
Software.license: BSD License

via Wikipedia infobox

Official website

Scrapy — open source web scraping framework for Python

Scrapy is the leading open source Python framework for web scraping — fast, asynchronous, extensible, and BSD-licensed. Trusted by millions of developers.

scrapy.org →

Link to the official site · 6,101 chars · not written by Vinony

Described at

TAPoR

tapor.ca →

Scrapy is an open source programming library for web crawling and web page text extraction, written in Python. You can make calls to Scrapy code from within your own scripts and applications to automate the task of extracting data from websites. You would typically use Scrapy to automate the task of visiting one or more web pages, on a website to which you have access. You could alternately use it to invoke web-based Application Programming Interfaces (APIs).

Excerpt from a page describing this subject · 2,477 chars · not written by Vinony

Source code

github.com →

Link to the source-code README · 2,149 chars · not written by Vinony

Wikidata facts

Instance of: software
Official website: scrapy.org
Has use: data visualization

Show 9 more facts

source code repository URL: github.com/scrapy/scrapy
programmed in: Python
copyright license: 3-clause BSD License
issue tracker URL: github.com/scrapy/scrapy/issues
software quality assurance: continuous integration
software version identifier: 2.15.1
described at URL: marketplace.sshopencloud.eu/tool-or-service/UfX6Ad
operating system: Berkeley Software Distribution
social media followers: 5365

Sources (11)

via Wikidata · CC0

Article · Italiano

Da non confondersi con Scrapie Scrapy (/ˈskreɪpaɪ/ SKRAY-PEYE ) è un framework open source per web-crawling scritto in Python. Originariamente creato per web scraping può essere anche utilizzato per estrarre dati usando delle API oppure come un web-crawler general-purpose. È mantenuto da , uno sviluppatore di web-scrapers e compagnia di servizi. L'architettura del progetto di Scrapy consiste in "ragni", che sono web-crawler che sono dati un set di istruzioni. Seguendo lo spirito di framework don't repeat yourself, come Django, rende semplice costruire e scalare progetti di crawling grandi, concedendo agli sviluppatori di riutilizzare il loro codice. Scrapy offre anche una shell per web-crawling, che può essere usata dagli sviluppatori per testare delle assunzioni su un comportamento di un sito. Alcune compagnie conosciute utilizzano Scrapy come: Lyst, , , Sciences Po Medialab, .

Abstract from DBpedia / Wikipedia · CC BY-SA