All about Data EngineeringAzure pipeline Yaml with exampleBefore creating azure pipeline its important to understand some of the key concepts in pipeline YamlMay 27, 2023May 27, 2023
All about Data EngineeringAZURE Repos || Service Connection || Artifact || Key VaultBefore jumping into pipelines and deployments its important to understand Azure Repos, Azure Service Connection, Azure Artifact and Azure…May 26, 2023May 26, 2023
All about Data EngineeringAzure DataBricks: Connect to Azure Synapse using Service PrincipalIn this article let's see how to connect to the azure synapse server using service principal authentication.May 26, 20232May 26, 20232
All about Data EngineeringAzure Pipelines and CI/CDThis article gives complete information on Azure pipelines, Continous Integration, and Continous Delivery/Deployment. Please go through the…May 25, 2023May 25, 2023
All about Data EngineeringCreate API for a database using FastApiWhat is FastApi?Mar 25, 2023Mar 25, 2023
All about Data EngineeringPython code to connect to Azure SQL/Azure Synapse using Azure AD Service Principals from a Python…In order to access an azure resource from a application it is not recommended to use email and password, we should use a secure identity…Dec 8, 2022Dec 8, 2022
All about Data EngineeringUnexpected error encountered filling record reader buffer: ClassCastExceptionThis is one of the common issue while loading a parquet file to Azure sql database or Azure Synapse Dedicated SQL Pool.Oct 7, 20221Oct 7, 20221
All about Data EngineeringCommon issues with Parquet files in AZUREIssue descriptionSep 25, 2022Sep 25, 2022
All about Data EngineeringAzure SQL database Vs Azure Synapse SQL Dedicated PoolIf you have ever encountered a situation on whether Azure SQL database or Azure Synapse dedicated pool is the best fit for your data…Sep 23, 20221Sep 23, 20221
All about Data EngineeringDifferences between Database, DataWarehouse and Data LakeThis article gives you a high-level understanding on the differences between Database, Data Warehouse and Data Lake.Sep 11, 20221Sep 11, 20221