Anjan Banerjee·Jan 12IaC 101: Building Reliable Infrastructure with the Power of CodeFor many organizations, infrastructure management often presents issues due to the time and effort required to manually provision and configure resources. …Iac9 min readIac9 min read
Anjan Banerjee·Jan 5Hand-Picked Tools for Building an Open-Source Data PlatformOpen-source alternatives to market-leading tools and technologies can help you build and optimize a flexible, performant end-to-end data platform. This is a good option for organizations that want to achieve greater control and significant cost savings and can afford to put in some time and effort in exchange for these…Data Platforms5 min readData Platforms5 min read
Anjan Banerjee·Dec 13, 2022So What’s All This Talk about Zero-ETL Integration?Those who followed AWS’s re:Invent 2022 event may have caught multiple mentions of zero-ETL ingestions — but you’d be forgiven for not being caught up with what zero-ETL is and, even more importantly, what it means for your organization. …Data Replication6 min readData Replication6 min read
Anjan Banerjee·Dec 8, 2022Look Out for These Data Engineering Trends in 20232022 saw large-scale layoffs and departures across major industries, and things generally seem to be on track towards a big reset. Credible voices are claiming we’re moving into a recession. So how can data-driven organizations prepare themselves to tackle whatever is to come in 2023 — and even emerge stronger? …Data Engineering7 min readData Engineering7 min read
Hanna Bekefi·Dec 7, 2022Data Visualization in 2023 — Seven Trends to WatchFor those professionally involved in data visualization — either as a practitioner or consumer — don’t expect to be here in a year viewing dashboards in a VR headset. 2023 most likely won’t be dominated by flashy and visionary tech advancements in the field but rather be centered around practical…Data Visualization7 min readData Visualization7 min read
Chris von Csefalvay·Dec 5, 2022Five Healthcare AI/ML Trends to Watch for in 20232022 has been an interesting year for healthcare AI/ML. It saw, among others, a consolidation of pandemic-induced practices, such as a shift towards virtual care (especially in primary care), into the ‘new normal’ of healthcare delivery. The COVID-19 pandemic has spurred providers and payors alike to rethink traditional models of…Healthcare6 min readHealthcare6 min read
Tamas Foldi·Oct 17, 2022Ingestions in DBT: How to Load Data from REST APIs with SnowparkWe all know the status quo in the modern data stack: Ingestion tools for ingestions and transformation tools for transformations. Use Fivetran, Airbyte or Meltano to get the data in, then run dbt models to transform them. But do we always need ingestion tools? …Dbt6 min readDbt6 min read
Anjan Banerjee·Oct 14, 20225 Underrated VS Code Extensions You’ll Love as a Data EngineerVS Code is one of my favorite tools, and with some well-chosen extensions, it becomes even more powerful. VS Code provides a lightweight, powerful and customizable work environment. This enables you to quickly find all the necessary features in it. There is also a vast collection of extensions available for…Data Engineering4 min readData Engineering4 min read
Zsolt Palmai·Oct 13, 2022Learning to Stop Worrying and Augment Your AnalyticsI don’t think about memes a lot — or much of them — but lately this one has been on my mind: We have billionaires taking joyrides to space, and yet we keep manually updating Excel spreadsheets to uphold what we know as “order” in our world. …Data Science5 min readData Science5 min read
Tamas Foldi·Oct 5, 2022Dagster + Airbyte + dbt: How Software-Defined Assets Change the Way We OrchestrateA few weeks ago, I heard an interview with Dagster founder Nick Schrock on the Data Engineering Podcast. Although I tried Dagster way back in its early stage, listening to Nick’s approach to Software-Defined Assets (SDA) in the data orchestration field intrigued me enough to give the new, 1.0 version…Dagster7 min readDagster7 min read
