Prateek Dubey – Medium

Prateek Dubey

Apache Spark on Kubernetes — On-Premise (Ceph) and AWS (S3)

In this article we will go through how Kubernetes works as a Cluster Resource Manager for deploying Apache Spark applications. Spark as a…

Sep 24, 2021

Apache Spark on Kubernetes — On-Premise (Ceph) and AWS (S3)

Sep 24, 2021

JupyterHub on Kubernetes — AWS & On-Premise

This article is a continuation to my previous article on how I built a Data Platform — On-Premise on Kubernetes. To further explain how…

Sep 21, 2021

JupyterHub on Kubernetes — AWS & On-Premise

Sep 21, 2021

Data Platform — On-Premise on Kubernetes

This article is about some of the work I have been doing in my prior and current organization around Data Infrastructures. For the past…

Sep 20, 2021

Data Platform — On-Premise on Kubernetes

Sep 20, 2021

Databricks on Azure

Databricks is a Unified Data Analytics Platform created by Apache Spark Founders. It provides a PAAS on Azure (Partnered with Microsoft)…

Jul 9, 2020

Databricks on Azure

Jul 9, 2020

Databricks on AWS

Databricks is a Unified Data Analytics Platform created by Apache Spark Founders. It provides a PAAS on AWS Cloud to solve complex Data…

Jul 9, 2020

Databricks on AWS

Jul 9, 2020

My Business Intelligence to AI Infrastructure Journey

I graduated from University of Pune, India with a Bachelor of Engineering degree majoring in Computer Engineering in 2013. I wanted to…

Jul 9, 2020

My Business Intelligence to AI Infrastructure Journey

Jul 9, 2020

Terraform Cloud Infrastructure — AWS, Azure and GCP

Automation of Cloud Infrastructure is a norm that every company follows. Whenever we think of Cloud platforms, the first thing that comes…

Jul 9, 2020

Terraform Cloud Infrastructure — AWS, Azure and GCP

Jul 9, 2020

Free Community Edition Databricks Account

To setup a Databricks Account, firstly we need to Sign Up using below link

Jun 30, 2020

Free Community Edition Databricks Account

Jun 30, 2020

Databricks x Airflow Integration

Databricks comes with a seamless Apache Airflow integration to schedule complex Data Pipelines.

Jun 30, 2020

Databricks x Airflow Integration

Jun 30, 2020

Secure AWS Networking

To design a secure Infrastructure, you must be wondering if we need help from a SRE (Site Reliability Engineer) or a DevOps Engineer who…

Jun 30, 2020

Secure AWS Networking

Jun 30, 2020

Prateek Dubey

Prateek Dubey

Data Engineering Manager/ Principal Data Engineer - Let's connect https://www.linkedin.com/in/prateekdubey11/

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech