☁ Object Storage Migration Service (OMS)

Mert Goktas
Huawei Developers
Published in
5 min readDec 4, 2023
Migration on-premises to cloud platform

Introduction

Hello to everyone.🙌 In this article, Huawei Cloud provides general migration services to users. It can perform different types of migration operations. The first method is the migration of Object Storage services created in different cloud providers to OBS in Huawei Cloud, and the second is the migration we can perform between the two OBSs we created on Huawei Cloud. Enjoyable reading, if ready your coffees. ☕

OMS Overview

Object Storage Migration Service

What Is OMS?

Object Migration Service provides Object Storage Migration Service, which is to migrate data from other clouds to Huawei Cloud’s OBS. It supports different cloud providers including AWS, Alibaba Cloud, Microsoft Azure, Baidu Cloud, and more. Object migration can be used in typical applications such as cloud disaster recovery and object restoration.

Advantages of OMS

  • It has a simplified interface for creating and managing migration tasks.
  • It has security features including access key identification secret access key and encrypted transmission.
Migration Process Schema

OMS ensures the security and integrity of data by:

● Integrity verification: OMS performs an integrity check for each transfer. By default, this check is performed based on the object size and last modification time. How

● Personal data encryption: To prevent your data from being stored Obtained from unauthorized use, OMS pre-encrypts your personnel data stores, controls access to data, and records operations performed on it data.

Identity Authentication

The OMS console, software development kits (SDKs), and application programming interfaces (PIs) are the three ways you can access OMS. Regardless of the approach you take, REST APIs are used to access OMS. Requests can be authenticated by OMS APIs. A signature value is a requirement for an authenticated request. The signature value is calculated based on the access key (AK/SK) of the requester and the specific information carried in the request body. OMS facilitates AK/SK pair authentication. It means it can use AK/SK-based encryption to authenticate a request sender.

OMS Permissions

By default, new IAM users do not have any permissions. To assign permissions to these new users, you need to add them to one or more groups and attach permissions policies or roles to these groups. Users inherit permissions from the groups to which they are added and can perform specified operations on cloud services.

Source platform needs permissions:

  • Listing all buckets
  • Obtaining bucket location
  • Listing objects
  • Obtaining object metadata
  • Obtaining object content

Destination platform needs permissions:

  • Listing all buckets
  • Obtaining bucket location
  • Listing objects
  • Obtaining object metadata
  • Obtaining object content
  • Listing uploaded parts
  • Restoring archive objects

Evaluating Data in a Bucket

A pre-migration assessment is advised if a source bucket has more than 5 million objects or 3 TB of data. For the system to automatically split and construct migration jobs based on the evaluation, the pre-migration evaluation gathers statistics on how many and how large objects are in the source bucket as well as an estimate of the amount of time required for the transfer. This significantly improves the service’s concurrent performance.

During the pre-migration evaluation, all of the fundamental data about the objects in a bucket must be thoroughly examined. The evaluation process will take a while if the bucket contains a lot of things.

Obtain Access Key and Secret Access Key

Identity and Access Management’s (IAM) authentication mechanism is supported by AKs and SKs.

A user’s access to the OBS system is identified by their Access Key ID (AK). A single user can possess more than one AK, but an AK can only belong to one user. By using their AKs, people can be identified by the OBS system.

The key that users use to access OBS is called a Secret Access Key (SK). It is the authentication data that is produced using the request header and the AK. A pair of access keys is made up of an AK and an SK group.

Obtain AK/SK for Huawei Cloud Account

1- Log in to OBS Console.

2- On the top navigation menu, click the username and select My Credentials.

3- On the My Credentials page, select Access Keys in the navigation pane on the left.

4- On the Access Keys page, click Add Access Key.

Object storage evaluation speed according to cloud providers:

  • Huawei Cloud: 27 million objects per hour
  • Alibaba Cloud: 27 million objects per hour
  • Tencent Cloud: 20 million objects per hour
  • AWS: 24 million objects per hour
  • Qiniu Cloud: 20 million objects per hour
  • Kingsoft Cloud: 20 million objects per hour
  • UCloud: 20 million objects per hour
  • Baidu Cloud: 21 million objects per hour

Migration Process 💻

OMS Migration Task

After creating AK/SK pairs for Destination and Sources, an OBS package is created to store the data. Create a migration task and start the task in the OMS console. Check the migration result in the OMS console. If the move task is successful, all source objects have been moved to the specified OBS package. If the migration task fails, the cause of the failure is checked and the migration task is restarted.

Related services

OBS: OMS can migrate objects to OBS buckets on Huawei Cloud.

Data Encryption Workshop (DEW): OMS can use the Key Management Service (KMS) on DEW to encrypt the data migrated to Huawei Cloud OBS.

Simple Message Notification (SMN): SMN notifies you of migration results.

Cloud Trace Service (CTS) CTS records operations associated with OMS for query, audit, and backtrack.

Billing

After the free period expires, you will be billed only for data migrated by OMS. This billing mode allows you to easily and flexibly forecast migration costs.

Conclusion

In conclusion, Huawei Cloud’s service, OMS, is a powerful tool designed to efficiently and securely move data to Huawei Cloud Object Storage Service (OBS). We have learned that it works integrated with Huawei Cloud services. Additionally, the service’s emphasis on ease of use, security, and versatile migration scenarios demonstrates Huawei’s commitment to providing a reliable and user-friendly cloud migration solution. This makes OMS an attractive option for organizations looking to use cloud data migration processes securely and efficiently.

References

--

--