PinnedViral PatelFix data issues in existing delta tables without reloading data from source.Fixes a data issue in a Databricks Delta table by performing an update on selected columns using a specified SQL function.Mar 2Mar 2
PinnedViral PatelApply Encryption to PII Fields of Delta TablesWhen it comes to the PII (Personally Identifiable Information) or Commercially Sensitive data, It is necessary requirement of most of the…Jan 175Jan 175
PinnedViral PatelDatabricks Delta Table StatusIn this blog, I will walk you through quick POC I have implemented to track the status of the the Delta table using delta table history. I…Jan 254Jan 254
PinnedViral PatelMetadata Driven Unity Catalog PermissionsMetadata driven permission for UC SecurablesJan 15Jan 15
Viral PatelUse Databricks Serverless Compute with Azure Data FactoryGood News! Long wait it over. Thank you Databricks for extending serverless compute to notebooks, jobs and pipelines.Sep 31Sep 31
Viral PatelDetermine Sql Query Cost using System TablesIn this article, I am going to share my experience of system tables. I will walk you through the journey i have gone through to find out…Aug 29Aug 29
Viral PatelIngest/Migrate Data from IBM DB2 to Azure using Databricks at Scale.In this blog, I would like to share my experience of ingesting large amount data from IBM DB2 using ADF (Azure Datafactory) and Azure…Jul 11Jul 11
Viral PatelDatabricks Sql Warehouse ServerlessVertical Scaling Databricks Sql WarehouseMay 251May 251
Viral PatelMigrate Hive metastore (HMS) Schema to Unity CatalogWelcome to the Migration Story of HMS to Unity Catalog.May 251May 251
Viral PatelDelta Lake Database/Schema Maintenance Part-2Optimize Performance and Cost of Delta Lake at ScaleApr 6Apr 6