Beautifulsoup — All that you need to know to get any data from any website using this Python library.

Felipe F Garcia
The Dev Project
Published in
21 min readMay 1, 2020

--

The goal here is to understand how you can use the library Beatifulsoup to fetch, retrieve any data from any website that you want.

I will explain from the beginning, the concept and how you should look to the data, also, some tips to some problems that you can find during scraping, as some tips to bypass some problems.

If you prefer to watch, I have a video about this tutorial, just go to the end of this post and access the link for Youtube.

The “action” that we want to do here has a name, it is “web scraping”, that is, load the web page that you want, search for any data that you want from there using a tool that can automatically fetch and parse this data for you.

These are the steps that we will present:

1 — Prepare your environment.
2 — Understanding how to use it.
3 — Using Beautifulsoup.
4 — Save the content and show it on your page.

Why use this?

For this question, there are many answers all are right, but you can, for example, use this to fetch and parse the data that you want to show on your website.

--

--

Felipe F Garcia
The Dev Project

Backend Engineer 💻 Java 👾 Python 🐍 Top Writer in Medium at the topic Technology 🚀 With a mindset to help and share knowledge 📖.