Stream Processing Access Logs: LoKI Stack

Airtel’s customer reach is tremendously vast, and so comes the chunk of data each…

Decision Tree

Introduction

Traditionally large organizations have leveraged proprietary software like CRM systems to…

How to Optimize Read CSV in Apache spark

Reading CSV is very common practice in big data. Normally we use spark api to read csv.

Using below method you can read csv 30% faster in spark.

Faster transforming datasets with Spark Internal Row

Designing and scaling a PetaByte Scale System — Part 1

Introducing Sentinel: Cross-Platform Test Metrics Framework

Designing and Scaling a PetaByte Scale System — Part 3: Even More Optimized ORC

At Airtel, when it…

Analyzing micro-optimizations in Java

Often We come up with multiple ways of doing a task. We try to write the fastest code. But…

Designing and scaling a PetaByte Scale System — Part 2