Six software-based practices to improve your development routineIf you need to do something more than twice, automate it.Jul 10, 2023Jul 10, 2023
Why carry Python environments with your OS? An alternative way.Have you ever noticed that PIP and Conda consume too much space from your OS? Why would they? Caching. Python environment managers try to…May 18, 2022May 18, 2022
Building a data engineering project. Part 4 — exploring CI/CD landscape + bonusWe’ve come a long way in making our data engineering project at this stage. Yet, is there anything that stops us from a round of applause…Mar 21, 20221Mar 21, 20221
Building a data engineering project. Part 3 — Kafka, containers, and making things reusableFrom Part 2, we have our system up and running locally. Looks nice, and we are satisfied? Not really. Remember the burden of first setting…Feb 19, 2022Feb 19, 2022
Building a data engineering project. Part 2 — architecture in code.So, we want to develop a tool that watches for specific words from what the people tweet in real-time. We finished part 1 of the project…Nov 30, 20211Nov 30, 20211
Published inCodeXBuilding a data engineering project. Part 1 — from idea to system design.Have you ever asked yourself a question “What do I do to land a data engineering job?” After surfing the Internet for a while, we have our…Aug 31, 20213Aug 31, 20213
