Ranith RanawakainITNEXTOptimizing a Databricks Cluster & Spark for High-ConcurrencyMost of the applications that run on spark, ETL workloads, or machine learning, mostly run on a single thread, it is not often that you…Mar 1Mar 1
Ranith RanawakaMultiple Concurrent Updates to a Databricks DeltaLake TableRecently I came across a situation where a single Delta lake table on data bricks is being inserted & updated by multiple processes running…Feb 17Feb 17