Adel HelalinCampaign Monitor EngineeringMultiple Spark Streaming Jobs in a Single EMR ClusterA managed Spark cluster can always save time on infrastructure maintenance. EMR (Elastic Map Reduce) is a tool that empowers data engineers…Feb 13, 20201Feb 13, 20201
Adel HelalinCampaign Monitor EngineeringEfficiently Compiling Spark Jobs Built in Scala and SBT on Build MachinesDeploying a Spark job can be challenging, especially considering that one Spark job is never the same as another. Deployment times can vary…Jan 21, 2019Jan 21, 2019
Adel HelalinCampaign Monitor EngineeringAutomating Deployments for Spark’s Structured Streaming on AWS EMRAnyone who’s familiar with submitting a Spark job will know it’s as simple as running a single command, so long as the Spark CLI is…Sep 26, 2018Sep 26, 2018
Adel HelalinCampaign Monitor EngineeringAggregating Event Streams in Redshift using MatillionIf you haven’t heard of Matillion, then it’s time you knew about it. If you’ve used ETL tools in the past like the traditional SSIS for…Nov 6, 2017Nov 6, 2017
Adel HelalinCampaign Monitor EngineeringDon’t Always Believe Your DataAs erroneous as that statement might seem, not trusting your data might be the most prudent thing you do. In this new age of data-driven…Feb 21, 20171Feb 21, 20171