Rachit AroraCustomised Conda environments for Jupyter NotebooksJupyter Notebooks is an interactive web interface for many to write code and use computational environments and resources without the…Apr 15Apr 15
Rachit AroraRings of security for Bigdata and AI pipelines on the cloudIn order to meet the increasing requirements of running more analytical jobs to get more insights into my organization’s data and reap…Dec 21, 2023Dec 21, 2023
Rachit AroraCustomize Spark runtime in IBM Cloud Pak for DataThis blog is written in Collaboration with Shobhit Shukla — He is the senior developer and data scientist with extensive experience in…Jan 17, 2022Jan 17, 2022
Rachit ArorainIBM Data Science in PracticeSpark on Knative (true serverless)Apache Spark is an open-source, scalable, massively parallel, in-memory execution engine for analytics applications. It is an essential…Aug 13, 2021Aug 13, 2021
Rachit AroraApache Spark Shuffle Service — there are more than one options!!The purpose of this blog is to provide a list of Shuffle Service Implementations in Apache Spark and motivation for their design choices…Jul 30, 20213Jul 30, 20213
Rachit ArorainIBM Data Science in PracticeAnalyzing Geospatial data in Apache SparkGeospatial data plays a crucial role in data forecasting, spatial analytics, and reporting, especially in the fields of logistics and…Mar 24, 20211Mar 24, 20211
Rachit ArorainIBM Data Science in PracticeWorking with different versions of Apache Hive with Spark service in IBM Cloud Pak for DataApache Hive is very popular data warehouse software. It is widely used for reading, writing, and managing large datasets residing in…Jan 25, 2021Jan 25, 2021
Rachit AroraUsing Apache Spark on IBM Cloud Pak for DataAI is not magic — but IBM Cloud Pak for data makes is magically simple! In each phase of the AI ladder viz, collect, organize, analyze and…Dec 3, 2019Dec 3, 2019
Rachit AroraTips for handling Images, containers and your Kubernetes clustersContainers and Kubernetes clusters has evolved and become more mature with additional security measures introduced in the image build…Jul 5, 2019Jul 5, 2019
Rachit Arora1 Million Spark run-times on KuberenetesI am very excited to share that we have successfully deployed over 1 million spark run-times in last 8 months.May 28, 20192May 28, 20192
