Unlocking Collaborative Data Insights: Delta Sharing and Power BI at Ingenii

Marko Djukic
Databricks Mastery
Published in
3 min readJul 3, 2023

In today’s data-driven landscape, seamless and secure data sharing is vital for effective collaboration and informed decision-making. Ingenii recognizes the significance of this need and has embraced Databricks’ Delta Sharing protocol. This innovative feature enables us to securely share data stored in Delta Lake with external clients, including Power BI. In this blog post, we will explore how Ingenii leverages Delta Sharing in conjunction with Power BI to revolutionize data collaboration and enhance decision-making processes.

The Power of Delta Sharing

Delta Sharing, a groundbreaking feature, allows the sharing of data stored in Delta Lake with users outside of the Databricks workspace. This feature provides a seamless mechanism for sharing data with business users, analysts, and developers who do not have direct access to Databricks.

Leveraging the Power BI Connector

Ingenii leverages the Databricks Delta Sharing connector for Power BI, empowering seamless connections to shared data and unlocking its potential for creating compelling visualizations and reports. This integration enables data-driven decision-making and effective communication of insights to stakeholders.

To begin using Delta Sharing with Power BI, follow these simple steps:

  1. Download the Databricks Delta Sharing credentials file from the Databricks environment.
  2. Open Power BI Desktop and navigate to the Get Data menu.
  3. Search for Delta Sharing and select the connector.
  4. Enter the Delta Sharing Server URL from the credentials file.
  5. Click Connect to establish the connection.

Driving Data-Driven Decision-Making

Once connected to the shared data, users gain access to a wide range of collaboration and analysis possibilities. Some key use cases include:

  • Creating interactive dashboards that provide real-time insights from Delta Lake tables.
  • Sharing reports with business users, enabling them to make informed decisions without direct Databricks access.
  • Automating report generation based on changes to Delta Lake tables.

The benefits and advantages of Delta Sharing with Power BI include:

  • Enhanced Security: Delta Sharing prioritizes data security by utilizing industry-standard encryption protocols during data transfers. This ensures the protection of sensitive information and restricts unauthorized access.
  • Scalability: Delta Sharing seamlessly handles large-scale data sharing applications, accommodating diverse data needs and fostering collaboration between organizations of all sizes. This scalability allows Ingenii to effortlessly share and access extensive datasets with clients.
  • Superior Performance: Delta Sharing excels in terms of performance, offering high-speed data reads and writes. By transmitting only the changes made to the data in the delta format, Delta Sharing optimizes data transfer efficiency and minimizes bandwidth usage.

Understanding the Limitations

While Delta Sharing provides substantial benefits, it is essential to consider its limitations:

  • Not all data can be delta shared: Delta sharing can only be used to share data that can be represented in a diff format. This means that some types of data, such as images and videos, cannot be delta shared.
  • Diff format can be complex: The diff format can be complex to understand and implement. This can make it difficult for some organizations to use delta sharing.
  • Delta sharing is not a silver bullet: Delta sharing is not a perfect solution for all data sharing problems. It is important to carefully consider the needs of your organization before deciding whether or not to use delta sharing.

Embrace Collaborative Data Insights

Ingenii recognizes the immense value of Delta Sharing as a powerful tool for unlocking collaborative data insights. By leveraging the capabilities of Delta Sharing, not only with Power BI but also with various other client applications, Ingenii empowers seamless data collaboration, facilitates informed decision-making, and elevates organizational performance.

The secure and efficient data sharing capabilities of Delta Sharing, combined with the visualization prowess of Power BI and other client applications, establish a formidable synergy that enables organizations to harness the full potential of their data and gain a competitive edge.

--

--

Marko Djukic
Databricks Mastery

Techie, entrepreneur, building data engineering solutions, working on quantum computing.