Adel HelalinCampaign Monitor EngineeringMultiple Spark Streaming Jobs in a Single EMR ClusterA managed Spark cluster can always save time on infrastructure maintenance. EMR (Elastic Map Reduce) is a tool that empowers data engineers…7 min read·Feb 13, 2020--1--1
Adel HelalinCampaign Monitor EngineeringEfficiently Compiling Spark Jobs Built in Scala and SBT on Build MachinesDeploying a Spark job can be challenging, especially considering that one Spark job is never the same as another. Deployment times can vary…3 min read·Jan 21, 2019----
Adel HelalinCampaign Monitor EngineeringAutomating Deployments for Spark’s Structured Streaming on AWS EMRAnyone who’s familiar with submitting a Spark job will know it’s as simple as running a single command, so long as the Spark CLI is…5 min read·Sep 26, 2018----
Adel HelalinCampaign Monitor EngineeringAggregating Event Streams in Redshift using MatillionIf you haven’t heard of Matillion, then it’s time you knew about it. If you’ve used ETL tools in the past like the traditional SSIS for…6 min read·Nov 6, 2017----
Adel HelalinCampaign Monitor EngineeringDon’t Always Believe Your DataAs erroneous as that statement might seem, not trusting your data might be the most prudent thing you do. In this new age of data-driven…4 min read·Feb 21, 2017--1--1