Writing scrapers the good way

If you start with from bs4 import BeautifulSoup 95 % of the times you are doing it wrong.

(burp community edition is enough to follow this tutorial)

(not) important disclaimer: always check the policy of the website you are trying to scrape, this is only for educational purposes

Small Intro

this can be skipped like I always do when I read a book