Introduction to Web Scraping -Simple Example

  1. Structure of the website and its elements.
  2. Data to be extracted.
  1. Find the website you want to scrap
  2. Find the data required
  3. Inspect the website code
  4. Write the script
  5. Run and fetch the data
  6. Perform operations(cleansing, visualization) on the data if required.
  7. Store the data.
  1. Selenium
  2. BeautifulSoup
  3. Scrapy
  4. Request
  1. Inspect by Ctrl+Shift+I

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Urvijain

Urvijain

Masters in Computer Science student at California State University, Sacramento. Interested in Data Science