Scrapy is a web crawling framework, which was designed for web scraping

Web scraping

Web scraping is a computer software technique of extracting information from websites...

. It is open-source and written in Python

Python (programming language)

Python is a general-purpose, high-level programming language whose design philosophy emphasizes code readability. Python claims to "[combine] remarkable power with very clear syntax", and its standard library is large and comprehensive...

. It is controlled using command line tools, that can be used to trigger the scrapers written in Python.

Scrapy was born in MyDeco, a UK startup. It soon became maintained, extended and
improved by Insophia and Mydeco employees. The first official release was in August, 2008, and it has been continually improved since then.