Why you don’t use a WebScrapy lib (Scrapy for example) in order of Splinter?
Andre Fonseca
341

Good question, Scrapy is quite an extensive library and good for large scale scraping projects. This article is targeted to help people who need to get data out of a website that has a lot of JavaScript. This is where Splinter/Selenium is a fast, simple choice. Selenium was originally intended for UI testing purposes but is good for scraping in certain circumstances (like in my article) and is good for building automation tools too.

One clap, two clap, three clap, forty?

By clapping more or less, you can signal to us which stories really stand out.