Export Table from Aurora PostgreSQL to Amazon S3

Image by Tim Hill from Pixabay

In this blog post I discuss how to export 100GB non-partitioned table from Aurora PostgreSQL to Amazon S3. I will walk you through two approaches that you can use to export the data. Firstly I will demonstrate using aws_s3, a PostgreSQL extension which Aurora PostgreSQL provides and then using AWS Glue service. The post also covers the performance and scaling challenges when exporting the table using AWS Glue.

Basic Information

• Database Details — I am running PostgreSQL 12.4 version on Aurora 4.0.2 version. The writer instance is running on db.r5.2xlarge having 8 vCPUs, 2 threads per code and 64Gb memory.

• Table Details — We will export the data for table “article” . The table is 100Gb in size and is non-partitioned.

• IAM Role — We will need an IAM role…