A closer look at Microsoft Fabric pricing, billing, and autoscaling — by Sam Debruyn

If you’re considering using Microsoft Fabric, you’re probably thinking “How much is this going to cost me?” Continue reading to learn how Microsoft might have just created the most…

How to use service principal authentication to access Microsoft Fabric’s OneLake — by Sam Debruyn

Microsoft recently added support to authenticate to OneLake using service principals and managed identities. This allows users to access OneLake from applications…

How to use Whisper, Open AI and ChatGPT to improve inclusivity with an intelligent voice assistant in the On Wheels app — by Sophie De Coppel

With the evolutionary wave of large language models (LLMs) come a lot new interesting…

Fabric end-to-end use case: overview & architecture — by Sam Debruyn

Welcome to the first part of a 5-part series on an end-to-end use case for Microsoft Fabric. This post will focus on the architecture overview of the use case.

Evaluating large language model applications with LLM-augmented feedback — by Maciej Piotrowski

Many large language models (LLMs) today can be evaluated and selected based on benchmarks that span a wide variety of tasks. These benchmarks, for example, on the Open…

Best Practices for Data Engineering on Google Cloud Platforms — by Dishani Sen

Data engineering is a crucial process involving data collection, storage, processing, and analysis. It plays a vital role in the data science lifecycle, enabling businesses to make informed…

Let Fabric teach you how to code with Data Wrangler — by Sam Debruyn

I’m going to be honest with you. I’m bad at writing Pandas data transformation code. Throughout the years I mostly focussed on the Spark APIs in Scala and PySpark, SQL, dbt, and some others, but I find the Pandas…

Enhancing Data Consistency in AI-powered Q&A Systems — by Senne Batsleer

At Dataroots, we are constantly exploring the latest advancements in the world of AI. In that regard, were currently developing a Q&A system powered by a Large Language Model (LLM). It has access to a vast…

Best Practices for Selecting a Database on Google Cloud Platform — by Dishani Sen

In our previous blog, we gently introduced GCP for data engineering and shared a lite edition of best practices, when it comes to data storage, security and machine learning. In this one, we…

Recovering the ink of Herculaneum using neural networks — by Adrien Debray

Context

In 79 AD, Mount Vesuvius erupted, thousands of scrolls in a library located in a Roman villa in Herculaneum were carbonized by the heat of the volcanic debris. For…