Data Observability

Shameless plug: On April 19, 2023, we’re gathering the largest collection of data reliability engineers and experts in the world. Join us for the third annual Data Reliability Engineering Conference (DRE Con)! Data and websites are two of your organization’s most valuable and visible assets. It’s only rational to have…

Data catalogs are essential parts of modern data infrastructures. They offer a centralized and standardized way to keep track of all data assets in an organization, including location, format, and source. By using a data catalog, data practitioners can easily find and understand the data they need for their work…

In my wanderings around many different data communities and social channels, it doesn’t take long before I end up in a conversation about efficiency, quality, cost, or discoverability. And data lineage is often suggested as the answer to many different problems in these discussions. But if data lineage is the…

Greetings, everyone! At OpenDataDiscovery, we understand the significance of providing our users with a comprehensive understanding of their data. This encompasses critical information such as data flow lineage, data structure, dataset ownership, and data health. It’s important to note that even a small dataset can have a significant impact on…

To date, 63% of companies are still in the experimentation phase with AI, and 80% of all AI projects are still stuck at the Proof of Concept level. These are sobering statistics. Wouldn’t you agree? In this article, I will update the insights I presented in my 2020 AI Sobering…

Authored by Mona Rakibe, Co-Founder/CEO of Telmai A chef preparing a gourmet meal might use a thermometer to check the temperature of the meat. A mechanic working on a car might use a dipstick to check the engine’s oil level. …

In order to improve your machine learning model, it is crucial to train it on high-quality data. Identifying problems in your data, particularly when you have a large amount of data, can lead to poor performance in your machine learning models. …

In Part 1 of this blog series, we provided an overview of Data Observability and explained how Kensu can assist with it. In part 2 of this blog series, we will delve into the specific steps to integrate Kensu in existing Databricks notebooks without requiring major changes or disruptions. To…