Jaynab KhatunAutomate Data Archiving Process from Redshift to S3Amazon Redshift is a fully managed data warehouse service. It is a petabyte-scale cloud data warehouse solution, which basically…Mar 12, 2023Mar 12, 2023
Jaynab KhatunReading data from JSON file using Spark in ScalaApache spark is emerging in the field of Machine learning and Data engineering, it has one of the nice things is the ability to read input…Jul 5, 2022Jul 5, 2022
Jaynab KhatunSQLite Database connection using python and import data into pandas data frameAs Data scientist or Data engineer, Data analyst always need to connect with their own database. Python provides many in-built packages to…Jul 5, 2022Jul 5, 2022
Jaynab KhatunHow to read multiple CSV file from S3 location using Lambda functionSometime we need to read data from S3 location. The data can be store in multiple file in S3. We can read data from multiple file like CSV…Jun 27, 2022Jun 27, 2022
Jaynab KhatunReading data from S3 and write it into DynamoDB using Lambda functionIn this, tutorial, I am going to show you how to read data from S3 location and at the same time write it into DynamoDB using Lambda…Jun 27, 2022Jun 27, 2022
Jaynab KhatunHow to connect Azure Data Lake Gen 2 or Azure Blob storage with Azure DatabricksAzure Blob storage is a storage service provided by Microsoft Azure that is used for storing large amounts of unstructured object data…Dec 13, 2021Dec 13, 2021
Jaynab KhatunHow to determine the right data distribution of a table using dedicated SQL pool in Azure Synapse…Azure synapse analytics is a limitless service provided by Microsoft Azure which brings together SQL for data warehousing, Spark tools for…Dec 9, 20211Dec 9, 20211