Sadeka IslamData Skew: Key solutionsData Skew is an anti-pattern where data is distributed unevenly across the table, thus leading to performance bottlenecks or even crash…Sep 3Sep 3
Sadeka IslamCustom Object Detection with YOLO v9This article demonstrates the basic steps to perform custom object detection with YOLO v9.Apr 24Apr 24
Sadeka IslamHow to transfer data in BigQuery?There are times when we need to transfer data from one dataset to another. For example, think of a scenario where you want to test your…Apr 23Apr 23
Sadeka IslamHow the serverless platform can boost your project’s cost and performance?Recently, we made transition to serverless Vertex AI from Airflow in our current project. There are three crucial reasons behind this move…Apr 21Apr 21
Sadeka IslamUsing private Python packages inside a Vertex AI kfp componentThere are times when The KFP components in a Vertex AI pipeline need to share some common packages among themselves. This page provides a…Jan 311Jan 311
Sadeka IslamBigQuery: Partition on any columnPartitioning helps us narrow the volume of data scanned by our queries. However, until today, BigQuery allows us to do partition on column…Jan 311Jan 311
Sadeka IslamHow to reset the Google Cloud project environment?Then you can login and set up a new project with the following commands.Oct 4, 2023Oct 4, 2023
Sadeka IslamCommon Errors and Solutions inVertex AI and BigQueryThis article intends to list commonly observed errors and their potential solutions in pipelines built with Vertex AI and BigQuery.Sep 15, 2023Sep 15, 2023
Sadeka IslamCase study: BigQuery Clustering & DenormalizationThis case study explores the performance of Clustering and Denormalization based on the BigQuery Stackoverflow public dataset.Aug 1, 2023Aug 1, 2023
Sadeka Islam4 simple cost optimization techniques for data pipelines in the CloudData pipelines sit at the core of today’s data-driven organizations. Typically, a data pipeline manages the flow of data from a source to a…May 28, 2023May 28, 2023