Apache Spark, Kubernetes and Azure
Apache Spark and Kubernetes are some of my favorite tools these days. And turns out you can run Spark jobs using Kubernetes as a resource manager. It sounds cool, but due to implementation differences between cloud providers and lack of documentation, it can get a bit…