PinnedAvoid partition skew on BigQueryData skew can significantly impact the performance and cost of processing large datasets in BigQuery.Dec 11, 2023Dec 11, 2023
PinnedPublished inPlumbers Of Data ScienceDynamic Data Masking on BigQueryBigQuery launched the support for dynamic data masking, which means we can obscure column data for groups of users. This also…Jun 24, 2022Jun 24, 2022
PinnedPublished inGoogle Cloud - CommunityKeyless API authentication- Launching GCP workloads from AWSCall GCP APIs directly from AWS or Azure without secret keysSep 10, 20213Sep 10, 20213
PinnedPublished inTowards Data ScienceA gentle introduction to the 5 Google Cloud BigQuery APIsWe know the potential of BigQuery, writing SQL without worrying about the infrastructure or scaling problems. This article tries to go…Dec 28, 2020Dec 28, 2020
Free virtual conferences for Data Engineers offered by Google CloudAs Data Engineer We always have to keep learning, and conferences are such a good opportunity to listen experts, and solve question.Jun 27, 2022Jun 27, 2022
Published inPlumbers Of Data ScienceRestrict access to columns on BigQueryManaging access to tables is not only restricted to the traditional level of access. Integrating Data Catalog with BigQuery we gain the…Jun 20, 2022Jun 20, 2022
Published inGoogle Cloud - CommunityRead BigQuery data faster using the Storage Read API with pythonWeeks ago I got an out-of-memory problem trying to read a table of more than 100 million rows and 30 columnsJun 16, 20225Jun 16, 20225
Short Book Review: Building Big Data Pipelines with Apache BeamA good opportunity to add a new technology for developing Data PipelinesFeb 22, 2022Feb 22, 2022
Published inPlumbers Of Data ScienceIncremental Data Ingestion in BigQuery using MERGEWhen you are building your Data Warehouse on BigQuery exists many techniques for ingesting your data. For example, you could make a…Dec 1, 2021Dec 1, 2021
Published inTowards Data ScienceSpeed up your ELT using BigQuery Cloud SQL FederationQuery data in your Cloud SQL instance in real-time, reducing ELT development time, avoid copying and moving data thanks to BigQuery Cloud…Sep 21, 20211Sep 21, 20211