Migrate your data between various platforms

AWS-Data Migration Service

Have you ever thought about migrating your production database from one platform to another and dropped the idea later, because it was too risky, and you were not ready to bare a downtime? If yes, then please pay attention because this is what we are going to perform in this article

If you are working in any role in technical team of your organisation then you must have heard about data migration at some point of your carrier.

Few days back we’re trying to migrate our production MySQL RDS from AWS to GCP SQL and we had to migrate data without downtime, accurate and real-time and that too without help of any Database Administrator.

After doing a bit research and evaluating few services we finally started working on AWS DMS (Data Migration Service) and found out this is a great service to migrate different types of data between different platforms also to convert schemas, no matter if you are using AWS or GCP, on premises server or DB configured in virtual machine, this service will help you in most of the cases.

AWS DMS helps you migrate databases to AWS quickly and securely. You can migrate your data to and from most widely used commercial and open-source databases, such as Oracle, Microsoft SQL Server, and PostgreSQL. The source database remains fully operational during the migration The service supports homogeneous migrations such as Oracle to Oracle, and also heterogeneous migrations between different database platforms, such as Oracle to PostgreSQL or MySQL to Oracle.

Let’s discuss about some important features about AWS DMS:

  1. Migrate database securely, quickly, accurate.
  2. No downtime Required.
  3. Works as schema convertor also.
  4. Supports Various type or database e.g. MySQL, MONGO, PSQL.
  5. Inexpensive (Pricing is based on the compute resources used during the migration process).
  6. Migrates real-time data also synchronise on-going changes.

7. And there are many more :)

Let’s do Step by Step data Migration:

We are here migrating data from AWS RDS to GCP SQL, you can choose database source and destination as per your requirement.

1. Create replication instance:

A replication instance initiates the connection between source and target databases, transfers the data, cache any changes that occur on the source database during the initial data load

Use the fields to below to configure the parameters of your new replication instance including network and security information, encryption details, select instance class as per requirement.

After completion all mandatory fields click the next tab, and you will be redirected to Replication Instance tab. Grab a coffee quickly while instance is getting ready.

Hope you are ready with your coffee because the instance is ready now.

2. Now we are to create two endpoints “Source” and “Target”

2.1 Create Source Endpoint

Click on “Run test” tab after completing all fields, make sure your Replication instance IP is whitelisted under security group.

2.2 Create Target Endpoint

Click on “Run test” tab again after completing all fields, make sure your Replication instance IP is whitelisted under target DB authorisation.

Now we’ve ready Replication Instance, Source Endpoint and Target Endpoint.

3. Finally we’ll create “Replication Task” to start replication.

Fill the fields like:

  • Task Name: any name
  • Replication Instance: The instance we’ve created above
  • Source Endpoint: The source database
  • Target Endpoint: The target database
  • Migration Type: Here I choose “Migration existing data and replication ongoing” because we needed ongoing changes also.

4. Verify the task status now.

Once all the fields are completed click on the “Create task” and you will be redirected to “Tasks”

Check your task status

Migrate your data between various platforms

The task has been successfully completed now, you can verify the inserts tabs and validation tab,

The migration is done successfully if Validation State is “Validated”

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store