PinnedDhiren NavaniApache Spark Optimization: Don’t count your chickensDon’t count your chickens before they hatch might not just be wise in life, but can also be a great recommendation for writing performant…Mar 10, 2023Mar 10, 2023
Dhiren NavaniComparing Terraform and Kubernetes CRD for Infrastructure as CodeKubernetes has emerged as the de facto container orchestration platform. Its flexibility, scalability, and robust ecosystem make it an…Feb 24Feb 24
Dhiren NavaniLeaky abstractions in Apache SparkWhy understanding the Spark internals is crucial for its optimal usage.Apr 16, 2023Apr 16, 2023
Dhiren NavaniUsing Python libraries with Scala in SparkApache Spark has grown to be a popular framework for big data processing. It is a powerful framework as it allows expressing logic in…Feb 20, 2023Feb 20, 2023
Dhiren NavaniDo you want it right or do you want it right now?This quote is from Patt Helland.Aug 30, 2021Aug 30, 2021
Dhiren NavaniIt is wrong to suppose that if you can’t measure it, you can’t manage it — a costly myth.The title is a quote by Edwards Deming. This quote applies to software as much as it applies to other industries.Apr 23, 2021Apr 23, 2021