Python Web Scraping: Scraping Data From Social Media (OSINT) Part 1
Happy Monday everyone, thought I would start the week off with an article about what I have been learning. In this series I am going to show you how to setup a development environment and parse data from social media sites. In this article I am going to take a deeper dive into Poetry and explain more of the commands and talked the project and with libraries I am going to use when aggregating data using open source intelligence techniques.
If you are new to Poetry check out this article:
Previous I talked about Poetry and how you can use the poetry cli to create a default project:
If you have ever managed a python managing dependencies is a nightmare. Python has a requirements.txt to track dependency versions but falls short. The requirements.txt is used to prepare a development environment, it lists project dependency and their version numbers. The pyproject.toml file is a solution for defining the build system as a dependency it lists information about dependencies as well project meta-data information. To install the dependencies from the pyproject.toml file run: poetry install:
