Shanoj – Medium

Featured Book

Stream Processing with Apache Flink & Pyflink: A Comprehensive Guide

Stream Processing with Apache Flink & Pyflink: A Comprehensive Guide

A comprehensive guide to Apache Flink, covering basics, advanced topics, and practical examples for real-time data processing applications.

2023

Stories

Shanoj
in
Stackademic

AWS-Powered Banking: Automating Reconciliation with Cloud Efficiency

This article explains how a Bank Reconciliation System is structured on AWS, with the aim of processing and reconciling banking…

3 min readApr 22, 2024

--

AWS-Powered Banking: Automating Reconciliation with Cloud Efficiency

--

Shanoj
in
Stackademic

Data Modelling for Data Warehouses: Bridging OLTP and OLAP for Advanced Data Analytics

This article offers a detailed exploration of the design and implementation of bank reconciliation systems within an Online Transaction…

6 min readApr 11, 2024

--

Data Modelling for Data Warehouses: Bridging OLTP and OLAP for Advanced Data Analytics

--

Shanoj
in
Stackademic

Apache Spark Aggregation Methods: Hash-based Vs. Sort-based

Apache Spark provides two primary methods for performing aggregations: Sort-based aggregation and Hash-based aggregation. These methods are…

6 min readMar 19, 2024

--

Apache Spark Aggregation Methods: Hash-based Vs. Sort-based

--

Shanoj
in
Stackademic

A Solution Architect’s Diary: Navigating Tech Frontiers with My Team of Superheroes

Back in the 2020s, a project requirement came my way that was both challenging and interesting. My manager and I were very new to the…

5 min readMar 12, 2024

--

A Solution Architect’s Diary: Navigating Tech Frontiers with My Team of Superheroes

--

Shanoj
in
Stackademic

Understanding Memory Spills in Apache Spark

Memory spill in Apache Spark is the process of transferring data from RAM to disk, and potentially back again. This happens when the…

5 min readMar 11, 2024

--

Understanding Memory Spills in Apache Spark

--

Shanoj
in
AWS in Plain English

Data Analytics with AWS Redshift and Redshift Spectrum: A Scenario-Based Approach

In exploring the integration of Amazon Redshift and Redshift Spectrum for data warehousing and data lake architectures, it’s essential to…

3 min readMar 6, 2024

--

Data Analytics with AWS Redshift and Redshift Spectrum: A Scenario-Based Approach

--

Shanoj
in
AWS in Plain English

AWS Glue for Serverless Spark Processing

AWS Glue Overview

3 min readFeb 26, 2024

--

AWS Glue for Serverless Spark Processing

--

Shanoj
in
Stackademic

Software Architect’s Career: Skills, Roles, and Progression [Part -1]

Competencies

3 min readFeb 20, 2024

--

Software Architect’s Career: Skills, Roles, and Progression [Part -1]

--

Shanoj
in
AWS in Plain English

Data Lake 101: Architecture

A Data Lake is a centralized location designed to store, process, and protect large amounts of data from various sources in its original…

5 min readFeb 5, 2024

--

Data Lake 101: Architecture

--

Shanoj

Review of ‘Quick Start Guide to Large Language Models’ by Sinan Ozdemir

This book is a well-structured guide that adeptly bridges the gap between theoretical concepts and their practical application in the field…

2 min readJan 27, 2024

--

Review of ‘Quick Start Guide to Large Language Models’ by Sinan Ozdemir

--

Shanoj

Shanoj

Book Author

Shanoj is a seasoned Solutions Architect with a wealth of experience delivering business value and actionable insights through well-architected data products.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams