BigQuery now allows Streaming with Client Libraries

Share Pub/Sub streaming Data through BigQuery sharing with additional Client Libraries

Photo by David Clode on Unsplash

Google just announced that you can now share Pub/Sub streaming data through BigQuery sharing with additional client libraries support and provider usage metrics[1].

With BigQuery and sharing via Pub/Sub topics through curate and distribute a library of streaming data across multiple internal and external organizational boundaries. Real-time streaming data is shared using BigQuery sharing exchanges and listings, allowing you to logically categorize and group large sets of Pub/Sub topics and provision access at scale[2].

Architecture of BigQuery and Pub/Sub — Image by Google[2]

• Shared Topics: A shared topic is the fundamental element used to distribute message data via Pub/Sub in a shared environment. As a publisher, you can either create a new Pub/Sub topic or use an existing one to send messages to subscribers. Note that Sharing does not duplicate the original Pub/Sub topic.
• Listings: A listing is created when a publisher adds a shared topic to an exchange. It acts as a pointer or reference to the shared topic.