List: Best in Data Engineering | Curated by theDataPM

Nov 16, 2022
16 stories
Best in Data Engineering
P Platter
in
Agile Lab Engineering
How to model Data ProductsWhen it comes to modelling Data Products people go into panic. There are no clear rules, only some conceptual and not actionable…
Nov 7, 2022
1
Nov 7, 2022
1
Brian Femiano
in
DataDrivenInvestor
Building a data model for The CircusA step by step case study in relational data modeling
Sep 22, 2022
1
Sep 22, 2022
1
Jean-Georges Perrin
in
The PayPal Technology Blog
The next generation of Data Platforms is the Data MeshHere’s why.
Aug 3, 2022
16
Aug 3, 2022
16
Astasia Myers
in
Memory Leak
Reverse ETL — A PrimerData infrastructure has gone through an incredible evolution over the past three years. We have moved from Extract, Transform, Load (ETL)…
Sep 6, 2022
13
Sep 6, 2022
13
Matt Darwin
in
Slalom Data & AI
Data Mesh: is the argument a strawman?noun: strawman
Oct 15, 2021
4
Oct 15, 2021
4
Mikkel Dengsøe
in
Towards Data Science
We’ve only scratched the surface of the full potential for the data warehouseIt may feel like we’re at the peak point for the data warehouse. Data teams are approaching 50% of engineering team size in some companies…
Jan 31, 2022
1
Jan 31, 2022
1
Christianlauer
in
CodeX
Data Lakehouse vs. Data MeshHow to use the new Approaches to become more Data Driven
May 5, 2022
May 5, 2022
Mikkel Dengsøe
How to measure data qualityPractical guidelines for how to measure quality, engagement and productivity in a data team
May 15, 2022
2
May 15, 2022
2
Barr Moses
in
Towards Data Science
Building a Data Platform: 7 Signs It’s Time to Invest in Data QualityAnd when to get started.
Feb 28, 2022
Feb 28, 2022
Robert Chang
in
The Airbnb Tech Blog
How Airbnb Achieved Metric Consistency at ScalePart-I: Introducing Minerva — Airbnb’s Metric Platform
Apr 30, 2021
10
Apr 30, 2021
10
Spotify Insights
in
Spotify Insights
Analytics Engineering at SpotifyWe’re always looking at how we cut and slice data to make sure we’re keeping up with the questions we are trying to answer.
Dec 3, 2020
2
Dec 3, 2020
2
Nathan Sullins
in
Udemy Tech Blog
Improving Amazon Redshift Performance: Our Data Warehouse StoryIt is challenging to manage an optimized Amazon Redshift cluster. Scaling the cluster to meet your growing storage and computation needs…
Dec 6, 2018
6
Dec 6, 2018
6
Louise de Leyritz
in
Towards Data Science
What is Data Modeling?The business value isn’t in your data, it lies in the transformation layer
Oct 6, 2021
1
Oct 6, 2021
1
Kat Hempstalk
in
The Startup
Building a Basic Data Lake With Prefect, S3, Glue, and AthenaI’m currently working with an indoor sensor startup, Smooth Sensors, and one of our challenges so far has been bespoke data analysis: when…
Jan 13, 2021
4
Jan 13, 2021
4
Pedro Gomes Mota
in
Data Arena
A new Enterprise Data Architecture for the new Data WorldThe idea behind this Multi-Layer Enterprise Data Architecture is to be a materialization of the Inverse Conway Maneuver.
May 11, 2021
2
May 11, 2021
2
Xavier Gumara Rigol
in
Adevinta Tech Blog
Treating data as a product at AdevintaA deep dive into how our teams implemented one of the data mesh architecture principles: treating data as a product.
Sep 21, 2021
1
Sep 21, 2021
1