Published inTowards DevUnderstand Parquet file format and how Apache Spark makes the best of itA file format which is actually helpful…interesting!Aug 11Aug 11
Published inTowards DevHandle Schema Evolution like your job depends on itThe blog topic says it all…Aug 1Aug 1
Published inTowards DevIncremental Load using Change Data Feed in DatabricksLearn incrementally loading a delta table, the easy way!Jul 25A response icon1Jul 25A response icon1
Published inTowards DevIndustry-Standard Architecture for Data Engineering ProjectsA sneak-peek into how actual Data Engineering project looks likeJul 19A response icon1Jul 19A response icon1
Published inTowards DevSpark — Beyond basics: Spark Internal Optimizations demystifiedSpark internal mysteries revealed!Jul 9A response icon1Jul 9A response icon1
Published inTowards DevSpark — Beyond basics: Chaos of NULLsThe uprising of NULLs! 😈May 15A response icon1May 15A response icon1
Published inTowards DevOptimize lengthy transformation sequences in Apache SpakWait for her text but not for your spark job to execute, read this blog!Mar 21A response icon1Mar 21A response icon1
Published inTowards DevIncremental Data Ingestion using Databricks AutoloaderCan I be more specific about the blog? 🤷Feb 5Feb 5
Published inTowards DevNuances of Data Engineering ft. Spark and DatabricksMy collection of bad interview experiences wrapped up in a blog🥲Jan 23A response icon1Jan 23A response icon1
Published inTowards DevMicrosoft Fabric — OverviewWe Data Engineers are cut from the same “Fabric” 🥸Jan 9Jan 9
