Optimizing Spark Performance with AQE: A Deep Dive into Apache Spark’s Adaptive Query Execution

Apache Spark is an open-source, distributed computing system used for big data processing. It is widely used for tasks such as data processing, machine learning, and…

How your story becomes viral?

Insights about the Medium core functionality, example from one of my…

How to write for Data And Beyond

My new publication aimed at attracting high-quality reproducible…

Predicting Airbnb rental prices in 10 European cities

SHAP values for the city, room type, distance to…

Timeless Obstacle for Data Products: Data Quality

Why Smart People Don’t Trust Data

Hint: It’s Not What You Think

Why SLAs are Critical for Reliable Data Organisations and Data Products

Towards constructing an unbiased Machine Learning regression model — an example of Airbnb rental prices

R-squared: A Brief Guide for beginners to Understand and Use it in Regression Analysis

R-squared is a statistical measure that indicates the proportion of variance in the dependent variable that is explained by the independent variables in the model. It ranges from 0…

The six steps in data analysis

Data analysis has become increasingly important in today’s business world. With the explosion of data…