Geek Culture
Published in

Geek Culture

I Might Not Have Switched to PySpark, Had I Found This Earlier

There’s a new python data processing engine in the town — will I be switching back?

Photo by Karolina Grabowska from Pexels

I’m a Senior Data Scientist tackling business problems in the retail domain, where millions of data points are collected daily. The data keeps flowing in — because you and I are shopping daily.




A new tech publication by Start it up (

Recommended from Medium

Maintaining Your Chill When Incorporating A11y

Reading 08: say fork 10 times fast

Supervisors and workers in 10 minutes

5 tools to automate your development

Designing Data Models for Firebase

Dev Day 29: Animating Sprites in Unity3D

Application configuration injection with StashBox and Telefónica Open Cloud Object Storage

Build a Data ETL Tool with Kaggle API on my Raspberry Pi Hadoop Cluster

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Arunn Thevapalan

Arunn Thevapalan

Senior Data Scientist & Top 1000 Writer. I write about my journey breaking into data science and building profitable side-hustles —

More from Medium

Learn from Silicon Valley’s Data Engineers: Dimensional Data Modeling is Dead

An Advanced SQL Syntax That Saved Me From Using Python

Python Data Classes, will save you hours of development!