Aaron PestelUsing Google Cloud Data Fusion APIs to get Pipeline Run Times and MetricsIf you’ve used Google Cloud Data Fusion (CDF) before, you’ve undoubtedly seen some of the important run metric screens like this one:Dec 2, 2021Dec 2, 2021
Aaron PestelGoogle Cloud Data Fusion — Extracting Pipeline Run Logs via APIIf you have worked much Google Cloud Data Fusion (CDF), you are probably aware that CDF provides an extensive API. Nearly everything that…Sep 8, 2021Sep 8, 2021
Aaron PestelUsing HAProxy with Cloud Data Fusion to Navigate Complex Network TopologiesOne of the most challenging aspects of any integration effort is networking, and Google Cloud Data Fusion (CDF) is no different. Sometimes…Sep 4, 20212Sep 4, 20212
Aaron PestelBigQuery as a Generic Database Source with Google Cloud Data FusionGoogle Cloud Data Fusion (CDF) has many native plugins for BigQuery (BQ Source, BQ Multi-Table Source, BQ Execute, etc.). In some cases…Aug 25, 2021Aug 25, 2021
Aaron PestelAutomated Firestore Replication to BigQueryFirestore is a very popular serverless document database on Google Cloud Platform (GCP). While Firestore is great at storing, updating, and…Aug 23, 20212Aug 23, 20212
Aaron PestelIntegrating Salesforce.com Data with Google Cloud Data FusionSo, you have data in Salesforce.com and you would like to access that data via a Google Cloud Data Fusion (CDF) pipeline? This is actually…Aug 20, 20211Aug 20, 20211
Aaron PestelListing Artifacts/Plugins in Google Cloud Data FusionA great feature of Google Cloud Data Fusion (CDF) is the plethora of plugins (artifacts) that are available out of the box — both plugins…Aug 19, 2021Aug 19, 2021
Aaron PestelBatch CDC with Data FusionA common use case with Google Cloud Data Fusion (CDF) is batch driven Change Data Capture (CDC). In this case, a CDC pipeline regularly…Aug 18, 20211Aug 18, 20211
