In this story I will walk you through the migration of AWS S3 data to Redshift through a python based easy-to-follow approach. In order to facilitate the replication and adaptation of this solution, all the steps will be executed using the python AWS API.

Scenario description

We have some data in S3 and the goal is to stage them in AWS Redshift. S3 (Simple Storage Service) is the cloud storage service by AWS. This allows storing big amount of data in a safe and efficient way, and make them easily available to other AWS services. AWS Redshift consists of a…

Luca De Francesco

Data Engineer at Roche. Passionate about data and tech. Interested in economics, finance, education, culture.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store