Kannan ThangarajuReal-time transformed data sync between major cloud storage (Ex: Azure to S3) using databricks and…Objective: To implement ETL live streaming from Azure to S3.Aug 7, 2022Aug 7, 2022
Kannan ThangarajuAn end-to-end Docker/ Fast API project to deploy APIs at scale part III. FinalLink to Part I and II:Jul 22, 2022Jul 22, 2022
Kannan ThangarajuinTowards DevAn end-to-end Docker/ Fast API project to deploy APIs at scale part II.Task requirements: Create an API that spits random data points based on a given input. Ex. If I give 5 it should return 5 random data…Jul 12, 2022Jul 12, 2022
Kannan ThangarajuAn end-to-end Docker/ Fast API project to deploy APIs at scale part I.Task requirements: Create an API that spits random data points based on a given input. Ex. If I give 5 it should return 5 random data…Jul 7, 2022Jul 7, 2022
Kannan ThangarajuDiscussion on some concealed issues faced in end-to-end data management Part IEasily identifiable issues come from error logs pinpointing the actual problem in our code. But how do we resolve those issues where it is…Jun 26, 2022Jun 26, 2022
Kannan ThangarajuinTowards DevThoughts on minimizing data movement in your ETL pipeline.There are many instances where your ETL pipeline refreshes the same data over and over again even though there is not much significant…Jun 18, 2022Jun 18, 2022
Kannan ThangarajuA case for Google Sheets in the contest of spreadsheets.I have used both excel and google sheets in my line of work. Also, Pardon me in advance for my biased view on google sheets. Here is the…Jun 4, 2022Jun 4, 2022
Kannan ThangarajuinDevOps.devAutomating clustered columnstore indexes for your SQL data warehouseAlright, so you have decided to start adding clustered columnstore indexes to all your tables in the data warehouse. But there are already…May 27, 2022May 27, 2022
Kannan ThangarajuRow-level security (RLS) for dynamic dashboards and data security.Many times we create the same dashboards with slightly different filters for different users. Ex: A separate sales dashboard for sales…May 20, 2022May 20, 2022
