Google launched Column Granularity for BigQuery

Set Column Granularity when you create a Search Index

Photo by NIR HIMI on Unsplash

Google just announced that you can now set the column granularity when you create a search index, which stores additional column information in your search index to further optimize your search query performance[1].

Last year Google launched Search Indexex for BigQuery. Your query performance can be greatly improved with an index. Savings in bytes processed and slot milliseconds are maximized when the number of search results make up a relatively small fraction of the total rows in your table because less data is scanned[2] — which will lead not only to faster queries but also to less costs.

Google made Query Search Indexes generally available

When creating a new table in BigQuery you can then create a search index on that table and columns with:

CREATE TABLE my_dataset.job_postings (job_id INT64, company_name STRING, job_description STRING);

CREATE SEARCH INDEX my_index
ON my_dataset.my_table(Job_id, job_description)
OPTIONS ( data_types = ['INT64', 'String']);