How to get continuous stream of data from these websites without getting stopped? Scraping logic depends upon the HTML sent out by the web server on page requests, if anything changes in the output, its most likely going to break your scraper setup.
If you are running a website which depends upon getting continuous updated data from some websites, it can be dangerous to reply on just a software.
Some of the challenges you should think:
1. Web masters keep changing their websites to be more user friendly and look better, in turn it breaks the delicate scraper data extraction…
