PinnedPublished inData Engineering XpertsNo SQL? No Problem: Ask Your Database Questions in Plain EnglishNon-members can access the full article through this Link.2d ago2d ago
PinnedPublished inData Engineering XpertsYour Spark Executors Are Wasting Memory — Here’s How to Fix ItNon-members can access the full article through this Link.Mar 271Mar 271
PinnedPublished inData Engineering XpertsZstd vs Snappy vs Gzip: The Compression King for Parquet Has ArrivedFor years, Snappy has been the go-to choice, but its dominance is being challengedDec 7, 2024Dec 7, 2024
PinnedPublished inTowards Data EngineeringBuilding Real-Time Recommendations with Spark, ALS, and KafkaEver wondered how online stores know exactly what you’d like to buy nextNov 30, 2024Nov 30, 2024
PinnedPublished inTowards Data EngineeringReal-Time Use-case : Fraud Detection in Financial Transactions with Kafka and Spark StreamingLeveraging Kafka and Spark Streaming for Real-Time Fraud DetectionNov 18, 2024Nov 18, 2024
Published inTowards Data EngineeringCatching Sneaky Data Drift Before It Wreaks HavocNon-members can access the full article through this Link.Apr 7Apr 7
Published inTowards Data EngineeringBuilding a Data Lakehouse with Iceberg, Spark, and AWS GlueNon-members can access the full article through this Link.Mar 82Mar 82
Published inData Engineer ThingsFrom Data Lake to Lakehouse: A Migration Guide with DeltaNon-members can access the full article through this Link.Feb 11Feb 11
Published inTowards Data EngineeringMastering CDC in Delta Tables: A Use-case in SparkNon-members can access the full article through this Link.Feb 5Feb 5
Published inData Engineering XpertsIndexing Strategies: B-Trees, Hash Indexes, Bitmaps & BeyondNon-members can access the full article through this Link.Jan 30Jan 30