Neil KolbaninGoogle Cloud - CommunityBigQuery External Tables with JSON dataI recently had a BigQuery puzzle involving JSON data files and being able to query their content where the field names of the JSON objects…2d ago2d ago
Neil KolbaninGoogle Cloud - CommunityDatastream and BigQuery — Append mode experimentsIn this article we illustrate some recipes for processing Datastream append mode change tables.Aug 29Aug 29
Neil KolbaninGoogle Cloud - CommunityProcessing arriving GCS files with PubSub triggersThe article describes experiments in processing Google Cloud Storage (GCS) files through BEAM where the content is to be inserted into…Aug 12Aug 12
Neil KolbaninGoogle Cloud - CommunityDynamic temporal correlations using BigQueryThe story described in this article is one that a colleague brought as a puzzle. I tried to find a solution and they themselves came up…Jul 281Jul 281
Neil KolbaninGoogle Cloud - CommunityDe-identifying BigQuery data using SDPOne of the many Google Cloud services is called Sensitive Data Protection (SDP). The purpose of this service is to find sensitive data…Jul 7Jul 7
Neil KolbaninGoogle Cloud - CommunityCloud Trace spanning PubSubTracing across PubSub (or other asynchronous action)May 30May 30
Neil KolbaninGoogle Cloud - CommunityBigQuery and Privacy PoliciesWhen thinking about published data and its privacy considerations, we also have to think about how an adversary might use the nature of the…Sep 10, 2023Sep 10, 2023
Neil KolbaninGoogle Cloud - CommunityDialogflow and Service DirectoryWhen using Dialogflow CX we often wish to invoke a Webhook backend to either dynamically retrieve some information or perform an action as…Aug 28, 20232Aug 28, 20232
Neil KolbaninGoogle Cloud - CommunityPreventing prod access with IAM ConditionsHow to prevent production from inheriting Google Cloud organization roles.Mar 13, 20231Mar 13, 20231
Neil KolbaninGoogle Cloud - CommunityStopping a Docker Container on COSConsider starting a Compute Engine instance that we wish to use to run a Docker container. Both the Google Cloud console and the gcloud…Feb 26, 2023Feb 26, 2023