PinnedAyman FarhatinGoogle Cloud - CommunityA guide to auditing Cloud Dataflow jobs cost via BigQuery billing exportThe GCP BigQuery billing export dataset is pretty useful for auditing costs related to service usage. Let’s explore our Dataflow job costs!May 11, 2022May 11, 2022
Ayman FarhatinGoogle Cloud - CommunityEliminate Auto-Scaling Bottlenecks by using Private IPs for Dataflow WorkersBy default, Dataflow workers have public IPs with limited quotas. Get around this limitation and improve security via private IPs.Mar 10, 2023Mar 10, 2023
Ayman FarhatinGoogle Cloud - CommunityManaging Airflow Logs on Google Cloud Storage with Object Lifecycle ManagementAirflow DAGs on Cloud Composer generate log files on Google Cloud Storage for every run. Those scheduled to run frequently, tend to…Aug 15, 2022Aug 15, 2022
Ayman FarhatinGoogle Cloud - CommunityAnalysing Git repository activities with BigQuery SQLReports generated from git platforms are great, but what if we need more flexibility towards creating git log reports? In this article we…Aug 10, 2022Aug 10, 2022