Apache Spark Optimization — Avoid groupByKey()

Apache Spark, a powerful open-source framework for big data processing, excels…

MLOps — How To Monitor Data Drift in Machine Learning Models

Deploying machine learning models comes with its unique set of challenges. In this article, we will delve into one of the challenges from a software engineering perspective, focusing on the critical aspect of monitoring. It’s…

Feature Store — How to pick up the right one for ML infrastructure

Generating features from raw input data is a time-consuming and complex process. Therefore, it makes sense to persist them for reuse across different models. The choice of storage (feature store) and how features…

Cloud — Cost Saving Strategies

Now, we are in the process of migrating our applications and systems to the cloud. Some are becoming cloud-enabled, while others are being…