How to use BigQuery GENERATE_TEXT remote function — Introduction Since I started working with the Google Platform, Google has not stopped surprising me with its BigQuery (BQ) features and development. A real “wow” moment for me happened four years ago. I remember it like it was yesterday, and I was sitting in the front row at the Big Data…

Raising awareness about learning three fundamental data concepts — As a data professional, I am just amazed by all the recent developments in the area of generative AI. While some call it hype and are willing to quickly write it off as just another tech trend, others are convinced it is a game-changer. Regardless of which stream you support…

Master Data and Analytics reports and processes with five templates — Introduction The best advice I got early in my career was to create templates for any reporting and development process. Although initially, I found the template creation time-consuming, this step in pre-development and pre-planning saved tons of my time in later work. And this is the knowledge that, nowadays, I try…

E-commerce journey on building a data platform with Google's tool stack — Building a data platform from scratch can be both exciting and daunting. Regardless if you are an early or late-stage company, your choices in building a foundational data platform will likely have a material impact on business for years to come. Of course, the initial objective should be to resolve…

Create external, shared and internal documentation in a systematic way — Data and Analytics teams are tasked with developing insights that drive decisions. These insights are often based on datasets gathered from multiple sources across the organization, including customer databases, sales histories, marketing campaigns, financial reports and more. The sheer volume of information can make it challenging to find the needed…

From data to insights: What do data analysts/scientists, data engineers and product owners do? — If you watched Penguins of Madagascar [1], you are probably familiar with the phrases “Kowalski, analysis” and “Kowalski, status report”. These two phrases are addressed to penguin Kowalski, whose job is to deliver the analysis or status report on the spot for different crisis scenarios. And if you work as…

Yet another approach for monitoring KPI targets — Control chart Statistics “a chart on which observed values of a variable are plotted, usually against the expected value of the variable and its allowable deviation, so that excessive variations in the quality, quantity, etc., of the variable can be detected” [1] Introduction During my bachelor's studies, one insightful Uni course was “Introduction…

Exploring and enriching the international BigQuery Google Trends dataset with Looker — Google Trends is a powerful keyword trend research website that provides insights into top search queries and their evolution across various countries and regions over time. In March 2022, Google announced the availability of a public Google Trends international dataset in BigQuery. Starting with the USA public dataset in 2021…

Handling missing values, window functions and nested queries with BigQuery SQL — One recent requirement that arrived in our Data and Analytics team was in the form of the question: “What is the number of year-to-date listed articles per shop, and how did this number evolve?” Finding the total number of listed year-to-date articles was not a complex analytical task. However, the…