Member-only story
BigQuery can now share Pub/Sub Topics and manage Subscriptions in Analytics Hub
More Option for Data Publishers
Google announced that they let BigQuery, Pub/Sub and Analytic Hubs grow together with benefits for Data Publishers[1].
Analytics Hub is a data exchange service that enables you to efficiently and securely share data assets across organizations to address data reliability and cost challenges.
The Google Analytics Hub is built on BigQuery and the publish and subscribe model of BigQuery datasets. The separation of compute and storage in BigQuery’s architecture enables data publishers to share data with as many subscribers as they want without having to make multiple copies of the data. Publishers are only charged for data storage, whereas subscribers only pay for queries that run against the shared data. The publisher and subscriber workflows in Analytics Hub are explained in detail in the following sections [2].
Now Google announced that you can now share Pub/Sub topics through Analytics Hub to curate and distribute a library of streaming data across multiple internal and external organizational boundaries. Real-time streaming data is shared using Analytics Hub exchanges and listings, allowing you to logically categorize and group large sets of Pub/Sub topics and provision access at scale[4].
With this new feature (for now in preview) you can share streaming data to realize use such as[4]:
- Share rapidly changing instrument prices, quotes, and orders in real-time
- Detect money laundering and payment fraud
- Help stores manage inventory in real-time
- Personalize marketing and customer support
- Adjust prices dynamically
- Monitor social media channels
- Optimize physical store layouts
and many more….
Sources and Further Readings
[1] Google, BigQuery release notes (2024)
[2] Google, Introduction to Analytics Hub (2022)
[3] Google, Analytics Hub (2022)
[4] Google, Stream sharing with Pub/Sub (2024)
