Geek Culture
Published in

Geek Culture

I Might Not Have Switched to PySpark, Had I Found This Earlier

There’s a new python data processing engine in the town — will I be switching back?

Photo by Karolina Grabowska from Pexels

I’m a Senior Data Scientist tackling business problems in the retail domain, where millions of data points are collected daily. The data keeps flowing in — because you and I are shopping daily.




A new tech publication by Start it up (

Recommended from Medium

Partition Labels — Day 31(Python)

Kubernetes Authentication & Authorization 101

Announcing Synthesized SDK in Google Colab

Automate As Much As You Can

Printing Longest Common Subsequence — Day 58(Python)

A new code-efficient CSS pattern for your theming and coloring needs

Face Detector in Python OpenCV🤖

Become A Global Ambassador of Phala Network!

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Arunn Thevapalan

Arunn Thevapalan

Senior Data Scientist & Top 1000 Writer. I write about my journey breaking into data science and building profitable side-hustles —

More from Medium

Is Python Spark Really 10x Slower Than Scala Spark?

Learn from Silicon Valley’s Data Engineers: Dimensional Data Modeling is Dead

Modern Data Stack: which place for Spark ?

The Battle for Data Engineer’s Favorite Programming Language Is Not Over Yet