PinnedHow I Decreased ETL Cost by Leveraging the Apache Arrow EcosystemIn the field of Data Engineering, the Apache Spark framework is one of the most known and powerful ways to extract and process data. It is well-trusted, and it is also very simple to use once you get the infrastructure set up. Understandably, most engineers will choose it for every task. However, in…Etl6 min readEtl6 min read
PinnedWriting LaTeX Documents In Visual Studio Code With LaTeX WorkshopIf you want to write LaTeX on your machine, VS Code is a great option for you! Installing all the necessary packages is a simple process. And with the power of Git, you can sync with web-based editors like Overleaf, and have satisfying versioning and backup. Why LaTeX ? For the uninitiated, LaTeX…Latex6 min readLatex6 min read
May 8Lightweight Large Data Extractions with Polars and ConnectorXIn my last blog post, I shared the latest tool that I have added to my arsenal — Apache Arrow (or the libraries based on it). In this post, I will delve deeper into the topic and demonstrate some of the techniques I employed. If you have not read it…Data7 min readData7 min read
