BigQuery now supports BigQuery Apache Iceberg Tables

Use BigQuery Storage Optimization for Apache Iceberg Tables

Christianlauer
CodeX

--

Photo by Karsten Winegeart on Unsplash

BigQuery tables for Apache Iceberg makes it possible to use BigQuery storage optimization for Apache Iceberg tables that reside in your own cloud buckets[1].

Already before you could analyse Apache Iceberg tables with BigQuery via BigTable. By using BigLake, you also have the advantage of accessing Apache Iceberg tables with finer-grained access control. You must therefore first create a BigLake Iceberg table by running a stored procedure for Apache Spark in BigQuery or Spark in Dataproc[1][2].

Now they launched Apache Iceberg Tables directly for BigQuery. It’s distinct from BigLake external tables for Apache Iceberg because only BigQuery tables for Apache Iceberg are modifiable directly within BigQuery. BigLake external tables for Apache Iceberg are read-only tables generated from another query engine, such as Apache Spark, and can only be queried using BigQuery[3].

--

--

CodeX
CodeX

Published in CodeX

Everything connected with Tech & Code. Follow to join our 1M+ monthly readers

Christianlauer
Christianlauer

Written by Christianlauer

Big Data Enthusiast based in Hamburg and Kiel. Thankful if you would support my writing via: https://christianlauer90.medium.com/membership

No responses yet