Google launched better Delta Lake BigQuery Integration

Delta Lake BigLake Tables are now generally available

Photo by Philipp on Unsplash

Google just made Delta Lake BigLake tables now generally available. That means that you can now easily query data with BigQuery via BigLake. Delta Lake is an open source, tabular data storage format that supports petabyte scale data tables[1].

Delta Lake is an open-source storage framework that enables building a format agnostic Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, Hive, Snowflake, Google BigQuery, Athena, Redshift, Databricks, Azure Fabric and APIs for Scala, Java, Rust, and Python[2].

Supported Ecosystem by Delta Lake — Image Source: Delta.io[2]

Now with the support of Delta Lake for BigQuery via BigLake you can access Delta Lake tables with more granular access control. BigQuery supports the following features with Delta Lake tables[3]:

• Access delegation: Query structured data in external data stores with access delegation. Access delegation decouples access to the Delta Lake table from access to the underlying datastore.
• Fine-grained access control: Enforce fine-grained security at the table level…