Data Science Foundation — AR1
The Fundamentals of Web Scraping Using Python & Its Libraries
Learn To Scrape Data Using Beautiful Soup, Scrapy, Selenium, and Scraping Tools
Web Scraping is the process of extracting data from the web in the form of text, tables, links, images, etc. This data is divided into two categories — private and public data. public data is a type of data that is publicly available for users to access like name, price, categories of a product, etc. Private data is a kind of data that is hidden from general users. It is only accessible to a particular user or the admin of the website. Some examples of private data can be user id, password, account number, pin, OTP, transactions, etc. You can only scrape public data legally.
Applications of Web Scraping
Web Scraping has a tremendous amount of applications like —
1. It can be used for automating price comparisons,
2. extracting reviews in bulk,
3. scraping weather reports,
4. product price tracking,
5. analyzing data.
