PinnedIntroduction to Databricks: A Beginner’s GuideIn this guide, I’ll walk you through everything you need to know to get started with DatabricksFeb 26, 20249Feb 26, 20249
PinnedFrom Database to AI: The Evolution of Data PlatformsLet’s explore potential stages of data platform evaluation to derive meaningful conclusions and identify the criteria needed to transition…Jan 8, 20247Jan 8, 20247
PinnedData Lakehouse vs Data Warehouse vs Data Lake-Comparison of data platformsFor decades, data warehouses have been the dominant architectural approach for building data platforms in enterprises. However, with the…Jul 24, 20234Jul 24, 20234
PinnedPublished inTDS ArchiveData Modeling Techniques For Data WarehouseData modeling is a process of creating a conceptual representation of the data and its relationships within an organization or system…Jun 19, 20234Jun 19, 20234
Vibe Coding in Data Engineering — Microsoft Fabric TestRecently, I became interested in a new term in software development: Vibe Coding. The concept behind this term is to let AI generate…Apr 141Apr 141
💡Claude Sonet on Azure Databricks- Automate ETL GenrationDatabricks recently announced the availability of Anthropic’s models on Azure Databricks, which means you can now leverage Claude Sonet for…Apr 111Apr 111
Process Automation with Databricks AI_QUERY FunctionThe AI_QUERY function simplifies access to large language models (LLMs) in batch processing. By integrating this function with your data…Mar 17Mar 17
📊Python Data Processing in Microsoft Fabric — End-to-End Transformation and VisualizationIn this post, I demonstrate how to build a data transformation in Microsoft Fabric using only Python and visualize data to provide…Mar 102Mar 102
Databricks Custom Data Source — Practical ExamplesThe Python Data Source API is a new feature introduced in Spark 4.0, allowing developers to read from custom data sources and write data…Mar 7Mar 7
💡Automate Microsoft Fabric Shortcuts for Databricks Unity Catalog IntegrationIn this story, I will share a tutorial on integrating with the Databricks Unity Catalog using shortcuts automation. This type of…Mar 11Mar 11
