Sanjayram Raja SrinivasanData Engineer as a NoobI always hated being called a noob — whether in gaming or anywhere else. But now, transitioning to the next step (which step, exactly?)…12h ago
Ethan KnoxinTowards Data ScienceThe Hindsight Guide to ReplatformingDissecting the motivations, risks, and potential rewards of a software “heart transplant”1d ago6
Pavan EmaniinArt of Data EngineeringMastering Architecture Diagrams and Technical Presentations: A Data Architect’s GuideHow to create impactful technical presentations and diagrams that effectively communicate complex ideas with precision and storytellingSep 201Sep 201
Ankush SharmainDevReadsBook Review: “Building Real-Time Analytics Systems” by Mark NeedhamEver wondered how food delivery apps track your order in real-time, or how e-commerce sites instantly recommend products as you browse?6h ago6h ago
Raphael MontaudinMedium EngineeringLearnings from optimising 22 of our most expensive Snowflake pipelinesWe recently spent a sprint focused on reducing our Snowflake costs. During this sprint, we investigated 22 of our most expensive pipelines…6d ago6d ago
Sanjayram Raja SrinivasanData Engineer as a NoobI always hated being called a noob — whether in gaming or anywhere else. But now, transitioning to the next step (which step, exactly?)…12h ago
Ethan KnoxinTowards Data ScienceThe Hindsight Guide to ReplatformingDissecting the motivations, risks, and potential rewards of a software “heart transplant”1d ago6
Pavan EmaniinArt of Data EngineeringMastering Architecture Diagrams and Technical Presentations: A Data Architect’s GuideHow to create impactful technical presentations and diagrams that effectively communicate complex ideas with precision and storytellingSep 201
Ankush SharmainDevReadsBook Review: “Building Real-Time Analytics Systems” by Mark NeedhamEver wondered how food delivery apps track your order in real-time, or how e-commerce sites instantly recommend products as you browse?6h ago
Raphael MontaudinMedium EngineeringLearnings from optimising 22 of our most expensive Snowflake pipelinesWe recently spent a sprint focused on reducing our Snowflake costs. During this sprint, we investigated 22 of our most expensive pipelines…6d ago
Vu TrinhinData Engineer ThingsI spent 8 hours learning Parquet. Here’s what I discoveredI finally sat down and learned about it.Aug 2415
Ritam MukherjeeData Skew in Spark : Using Salting while avoiding common mistakesData skew occurs when the data distribution across partitions is uneven. Imagine you’re working with user transaction data, and two users…13h ago