PinnedPublished inData Engineer ThingsBuilding a Local Data Lake from scratch with MinIO, Iceberg, Spark, StarRocks, Mage, and DockerHello again, fellow technology enthusiasts! I am a software/data engineer who transitioned from data science. The learning curve in this…Jul 13, 2024A response icon8Jul 13, 2024A response icon8
PinnedPublished inData Engineer ThingsData Pipeline Development with MinIO, Iceberg, Nessie, Polars, StarRocks, Mage, and DockerHello again, fellow technology enthusiasts!Oct 15, 2024A response icon2Oct 15, 2024A response icon2
Published inData Engineer ThingsAutomating Databricks Deployments: CI/CD with Asset Bundles and Semantic ReleaseHey again, fellow tech enthusiasts!Jun 4Jun 4
Published inData Engineer ThingsModernizing Databricks: Setting Up a Local Dev Environment with Dev Containers and Asset BundlesHello again, fellow technology enthusiasts!May 28May 28
Published inData Engineer ThingsLambda Architecture in Action — From Sensors to Dashboards with Kafka, Iceberg, Nessie, StarRocks…Hello again, fellow technology enthusiasts!May 22May 22
Published inData Engineer ThingsBauplan- The Serverless Data Lakehouse: WAP pattern exampleEnd-to-end Implementation of the Medallion Architecture and WAP Pattern — Without the HassleMar 22A response icon1Mar 22A response icon1
Published inLevel Up CodingFrom Zero to GitOps: Deploying Mage AI on Local Kubernetes with Argo CDThis is the second part of DevOps for Data Engineers seriesJan 15Jan 15
Published inLevel Up CodingDevOps for Data Engineers: Setting Up CI/CD Pipelines with Github Actions, Semantic Release and…Hey again, fellow tech enthusiasts!Dec 3, 2024Dec 3, 2024
Published inTowards Data EngineeringBuilding a Personal Finance Management App: Integrating REST API, Node.js,Hello fellow technology enthusiasts, I am a software/data engineer who transitioned from data science. This is the continuation of the…Mar 16, 2024Mar 16, 2024
Published inTowards Data EngineeringBuilding a Personal Finance Management App: Database Setup with PostgreSQL and Docker.Hello fellow technology enthusiasts, I am a software/data engineer who transitioned from data science. The learning curve in this new role…Mar 15, 2024A response icon1Mar 15, 2024A response icon1