☁️Auto Scaling For Huawei Cloud MRS
Introduction
Hello Everyone !
Today we will learn how to do automatic scaling for big data components in Huawei Cloud through an example scenario.
Enjoyable reading and developments😊
What is auto scaling?
First of all, we have stated many times that we use the term Auto Scaling to optimize our service by adding or removing ECS on a website during peak hours.
Auto scaling is a cloud computing feature that enables organizations to scale cloud services such as server capacities or virtual machines up or down automatically, based on defined situations such as traffic utilization levels.
Core auto scaling features also allow lower cost, reliable performance by seamlessly increasing and decreasing new instances as demand spikes and drops. As such, auto scaling provides consistency despite the dynamic and, at times, unpredictable demand for applications.
Which service should I use to use big data components at Huawei Cloud?
Map Reduce Service (MRS) provides enterprise-level big data clusters on the cloud. Tenants can fully control clusters and easily run big data components such as Hadoop, Spark, HBase, and Kafka.
Let’s see how this beauty, which is made for compute elements, can be made for Big data components !
Our demo has the following scenario:
A real-time processing service sees an unstable increase in data volume from 7:00 to 13:00 on Monday, Tuesday, and Saturday. For example, 5 to 8 task nodes are required from 7:00 to 13:00 on Monday, Tuesday, and Saturday, and 2 to 4 are required beyond this period.
You can set an auto scaling rule based on a resource plan. When the data volume exceeds the expected value, the number of Task nodes changes with resource loads, without exceeding the node range specified in the resource plan. When a resource plan is triggered, the number of nodes changes within the specified range with minimum affect. That is, increase nodes to the upper limit and decrease nodes to the lower limit.
The road map we will follow to realize the scenario:
- Creating Cluster on Huawei Cloud MRS
- Creating a task node group and activating the Auto Scaling option
- Defining Auto Scaling Policy for task node
1-Creating Cluster on Huawei Cloud MRS
After connecting to Huawei cloud console via a registered account, click MRS in the service list.
Click Buy Cluster button.
Select Custom Config option.
Select options like photo.
Select big data components.
Select VPC and cluster features.
Enter passwords.
Check auto scaling area for config text.
Check all options and click I Auto.. and Buy Now selection.
Click Back to Cluster List.
Check cluster name and status.
Wait status is Running.
2-Creating a task node group and activating the Auto Scaling option
After creating the cluster, we click on the node area within it and then create a task node to activate the autoscalling area.
Click cluster then click Nodes.
Click Add Node Group for Task Node.
Select options like photo.
Check creating task node group called node_demo.
3-Defining Auto Scaling Policy for Task Node
After activating our Auto Scaling option, we can now define our policy for the hours of 07:00–13:00 in our scenario.
Check Auto Scaling Area and click Create Auto Scaling Policy.
Select options like photo.
Select Scale-out selection.
Select options like photo.
Select I agree.. selection and click OK.
Check task node.
Check node status
Check task node status and Status is Running.
After seeing the node Running expression on the task, we defined the Autoscaling policy rule for the cluster. The number of nodes will be increased or decreased according to density within the specified hours.
Conclusion
I used Huawei Cloud services in my article. I recommend that you pay attention to billing when using these services. You can turn off the services after using them
You can provide feedback with comments and actions. Thanks..
