Scraping Data From the Web Using Requests and BeautifulSoup, Part 1

Jordan P. Raychev
The Startup
Published in
4 min readJan 18, 2021

--

Every now and then a client calls and ask from you to scrape a particular data from the Internet. Maybe you have to just download a simple file from a web page or scrape a page in order to find the information of interest. That is where tools like requests, Beautiful Soup and Selenium come into play. Each of the aforementioned libraries have its own pros and cons but we are not going to cover them in this article. Rather, we are going to take a closer look on how to download actual html data from a web page and write the output to a csv file.

--

--

Jordan P. Raychev
The Startup

Network, system and software engineer with true passion about technology. Love to read and spend time in nature.