☁️Huawei Cloud Search Service — Elasticsearch
Introduction 🚀
Hi everyone 😎 , In this article I will explain Elasticsearch and Huawei Cloud Search Service (CSS).
What is Elasticsearch ❓
Elasticsearch is a distributed, RESTful search and analytics engine capable of addressing a growing number of use cases. As the heart of the free and open ELK or Elastic Stack, it securely stores your data for lightning fast search, fine‑tuned relevancy, and powerful analytics that scale with ease.
Ingest
Elastic provides a number of components that ingest data. Collect and ship logs, metrics, and other types of data with Elastic Agent or Beats. Manage your Elastic Agents with Fleet. Collect detailed performance information with Elastic APM.If you want to transform or enrich data before it’s stored, you can use Elasticsearch ingest pipelines or Logstash.
Logstash
Logstash is a data collection engine with real-time pipelining capabilities. It can dynamically unify data from disparate sources and normalize the data into destinations of your choice. Logstash supports a broad array of input, filter, and output plugins, with many native codecs further simplifying the ingestion process.
Store
Elasticsearch
Elasticsearch is the distributed search and analytics engine at the heart of the Elastic Stack. It provides near real-time search and analytics for all types of data. Whether you have structured or unstructured text, numerical data, or geospatial data, Elasticsearch can efficiently store and index it in a way that supports fast searches. Elasticsearch provides a REST API that enables you to store data in Elasticsearch and retrieve it. The REST API also provides access to Elasticsearch’s search and analytics capabilities.
Consume
Kibana
Kibana is the tool to harness your Elasticsearch data and to manage the Elastic Stack. Use it to analyze and visualize the data that’s stored in Elasticsearch. Kibana is also the home for the Elastic Enterprise Search, Elastic Observability and Elastic Security solutions.
What is Huawei Cloud Search Service(CSS) ?
Cloud Search Service (CSS) is a fully hosted distributed search service based on Elasticsearch. You can use it for structured and unstructured data search, and use AI vectors for combine search, statistics, and reports. CSS is a fully managed cloud service of the ELK Stack and is compatible with open-source Elasticsearch, Kibana, and Cerebro.
Elasticsearch is a distributed search engine that can be deployed in standalone or cluster mode. The heart of the ELK Stack, Elasticsearch clusters support multi-condition search, statistical analysis, and create visualized reports of structured and unstructured text.
CSS can be automatically deployed, allowing you to quickly create Elasticsearch clusters. It provides the search engine optimization practices and does not require your O&M. Additionally, it has a robust monitoring system to present you key metrics, including clusters and query performance so that you can focus on the business logic.
How to create an Elasticsearch cluster in CSS ?
Prerequisites
Service Details
Let’s take a look at the CSS on the Huawei Cloud .
Nodes
Number of nodes in a cluster.
- If neither a master node nor client node is enabled, the nodes specified by this parameter are used to serve as both the master node and client node. Nodes provide the cluster management, data storage, cluster access, and data analysis functions. To ensure data stability in the cluster, it is recommended that you set this parameter to a value no less than 3.
- If only the master node function is enabled, nodes specified by this parameter are used to store data and provide functions of client nodes.
- If both the master and client node functions are enabled, the nodes specified by this parameter are only used for storing data.
- If only the client node function is enabled, nodes specified by this parameter are used to store data and provide functions of the master node.
Master node
The master node manages all nodes in the cluster. If more than 20 nodes are required to store and analyze a large amount of data, you are advised to enable the master node to ensure cluster stability. Otherwise, you are advised to set only the Nodes parameter and use the nodes as both master and client nodes.
After enabling the master node, specify Node Specifications, Nodes, and Node Storage Type. The value of Nodes must be an odd number equal to or greater than 3. Up to nine nodes are supported. The value of Node Storage Capacity is fixed. You can select a storage type based on your needs.
Client node
The client node allows clients to access clusters and analyze data. If more than 20 nodes are required to store and analyze a large amount of data, you are advised to enable the client node to ensure cluster stability. Otherwise, you are advised to set only the Nodes parameter and use the nodes as both master and client nodes.
After enabling the client node, specify Node Specifications, Nodes and Node Storage Type. The value of Nodes ranges from 1 to 32. The value of Node Storage Capacity is fixed. You can select a storage type based on your needs.
Cold data node
The cold data node is used to store historical data, for which query responses can be returned in minutes. If you do not quire a quick query response, store historical data on cold data nodes to reduce costs.
After enabling cold data node, configure Node Specifications, Nodes, Node Storage Type, and Node Storage Capacity. The value of Nodes ranges from 1 to 32. Select Node Storage Type and Node Storage Capacity as requirement.
After the cold data node is enabled, CSS automatically adds cold and hot tags to related nodes.
Security Mode
After the security mode is enabled, communication will be encrypted and authentication required for the cluster.
HTTPS Access
HTTPS access can be enabled only after the security mode of the cluster is enabled. After HTTPS access is enabled, communication is encrypted when you access the cluster.
Public IP Address
If HTTPS Access is enabled, you can configure Public Network Access and obtain an IP address for public network access. This IP address can be used to access this security cluster through the public network.
OBS bucket
Select an OBS bucket for storing snapshots from the drop-down list box. You can also click Create Bucket on the right to create an OBS bucket.
Backup Path
Storage path of the snapshot in the OBS bucket.
IAM Agency
IAM agency authorized by the current account to CSS access or maintain data stored in the OBS bucket. You can also click Create IAM Agency on the right to create an IAM agency.
VPC Endpoint Service
After enabling this function, you can obtain a private domain name for accessing the cluster in the same VPC.
Kibana Public Access
You can configure this parameter only when security mode is enabled for a cluster. After enabling this function, you can obtain a public IP address for accessing Kibana.
Conclusion
Huawei Cloud’s Elasticsearch service is an effective tool for meeting users’ data search and analysis needs. Its features and advantages make it easy to deploy and scale Elasticsearch applications, while providing high performance and reliability. The service’s high availability, automatic scaling, and backup features ensure that Elasticsearch applications run smoothly and securely.
👓You can reach me from my Linkedin account for all your questions and requests.
Hope to see you in my next article…
References🎈
1-Huawei Cloud CSS
2-Elasticsearch
