Big Data WAL

A Write Ahead big data journey Log. Articles about Distributed processing, Stream processing, Batch processing, Lambda Kappa Architectures, Small Data Structures, NoSQL & SQL Databases.

Serverless Smart Radio— Part III — Lambda functions

You’re currently reading Part III of the Serverless Smart Radio article. Head over to read Part I if you missed the introduction or check…

Bahadir Cambel

Oct 31, 2018

Latest

Bahadir Cambel

Oct 26, 2018

Serverless Smart Radio — Part II — Step functions

You’re currently reading Part II of the Serverless Smart Radio article…

Bahadir Cambel

Oct 19, 2018

Serverless Smart Radio

You are currently reading part I of the Serverless Smart Radio series. In this article, I will be mainly talking about…

How to build an Event Pipeline Part 2: Transforming records using Lambda Functions

Bahadir Cambel

Feb 18, 2018

How to build an Event Pipeline within 1 hour and minimum lines of code in AWS

How to speed up query times 14x by pre-aggregating tables

tl;dr; Pre-aggregate columns that you really need for your analytical queries, create tables by each day but keep the data as hourly, sum all the things you need, and combine all the queries(using UNION ALL ) to achieve to up most…

Apache HBase — Part I

Distributed column-oriented store on top of HDFS. HBase is Schemaless, Wide, Denormalized. It’s similar to Apache Cassandra, however HBase has a tight integration with HDFS, and data is accessible via multiple ways. (Direct HDFS, Thrift, Avro, REST, Java)

A Gentle introduction to Apache Drill

I hear you saying yet another Apache project, but this one is really useful right away.

Drill designed to use SQL statements to query S3, HBase, HDFS, MapR-DB, Swift, Google Cloud Storage, local files, RDBMSs and garbage schemaless db…