PinnedDhusanth ThangavadivelinITNEXTConsume Databricks Job ID, Job Run ID and Task Run ID in Python ModuleIn the previous article, it was discussed about deploying databricks job with python wheel task. When these jobs are deployed to databricks…Aug 5Aug 5
Dhusanth ThangavadivelinITNEXTQuery against external data sources in Databricks Unity CatalogExecute Lakehouse Federated QueriesSep 2Sep 2
Dhusanth ThangavadivelinITNEXTDeploy Databricks Jobs with Python Wheel TaskThere are multiple ways to deploy jobs in databricks with all dependencies through CICD process. Terraform, Databricks Asset Bundles and…Aug 2Aug 2
Dhusanth ThangavadivelinITNEXTStreaming Architecture in AWS to capture tweets in near real timeIntroduction:Jan 4, 2023Jan 4, 2023