Omid VahdatyThe Hulk Buster (LEGO) Experience — Some InsightsBuying your first insanse LEGO product, non trivial tips and tricksApr 1, 20231Apr 1, 20231
Omid VahdatyAirflow file sensor example | Airflow DemystifiedI recently encountered an ETL job, where the DAG worked perfectly and ended in success, however the underlying resources did not behave as…Apr 15, 2020Apr 15, 2020
Omid VahdatyAirflow XCom examples | Airflow demystifiedGetting started on Airflow Xcom | 5 ExamplesApr 15, 2020Apr 15, 2020
Omid Vahdaty80% Cost Reduction in Google Cloud BigQuery | Tips and Tricks | Big Query Demystified1. Install BQ mate — plugin for chrome in order to see cost per query in dollars before running.Nov 6, 2019Nov 6, 2019
Omid VahdatyBig Query Demystified |what really happens when you unnest customDimentions in ga_sessions_* (hint…I wanted to share with a problem i found while working in BigQuery and google analytics 360 data: ga_sessions_*Jan 19, 2019Jan 19, 2019
Omid VahdatyBig Data Demystified | Using AI to optimize BigQuery“Using AI to optimize BigQuery”Jan 10, 2019Jan 10, 2019
Omid VahdatyBig Data Demystified | Data Engineering DemystifiedWant to learn about Data Engineering? what is it? what are the challenges? Start with this teaser, and stay tuned for the next serias of…Jan 10, 2019Jan 10, 2019
Omid VahdatyBig Data DemystifiedA while ago I entered the challenging world of Big Data. As an engineer, at first, I was not so impressed with this field. As time went by…Dec 21, 2018Dec 21, 2018
Omid VahdatyEMR and watchdog: service-nanny?Want to have a watchdog to start the service if it crashing for any reason?Sep 2, 2018Sep 2, 2018
Omid VahdatyBootstrapping EMR from 0900 to 1700 on each work day with AWS Cloud Formation and AWS Data…This article covers some options to bootstrap a daily AWS EMR cluster to work continuously from 0900 in the morning to 17:00 , e.g office…Aug 17, 2018Aug 17, 2018