☁️ How can Huawei CCE be monitored using LTS (Log Tank Service) on Huawei Cloud?

Rabia Yılmaz
Huawei Developers
Published in
8 min readDec 26, 2023

Introduction

☁️️ Huawei Cloud CCE Service is a service for creating, running, and scaling Kubernetes-based applications. CCE Service logs provide valuable insights for monitoring the health and performance of your applications, detecting security threats, and optimizing resource utilization.

♻️️ The Huawei Cloud LTS service is a service for collecting, storing, and analyzing CCE Service logs. LTS makes it easy to manage and analyze CCE Service logs by collecting them in one place.

In this article, you will learn how to monitor CCE Service logs using the Huawei Cloud LTS service.

Requirements:

What is Log Tank Service

Huawei Cloud LTS Service

Log Tank Service (LTS) collects log data from hosts and cloud services. By processing a massive number of logs efficiently, securely, and in real-time, LTS provides useful insights to optimize the availability and performance of cloud services and applications. It also helps you efficiently perform real-time decision-making, device O&M management, and service trend analysis.

Huawei Cloud LTS Service

LTS collects logs from hosts and cloud services and displays them on the LTS console in an intuitive and orderly manner. You can transfer logs for long-term storage. Collected logs can be quickly queried by keyword or fuzzy match. You can analyze real-time logs for security diagnosis and analysis, or obtain operations statistics, such as cloud service visits and clicks.

Huawei Cloud LTS Log Collection and Analysis

What is CCE

Huawei Cloud CCE, or Cloud Container Engine, is a fully hosted Kubernetes service that allows you to build, run, and scale containerized applications. It’s a powerful tool that can help you modernize your applications and take advantage of the benefits of containerization, such as:

  • Increased agility and flexibility: Containers are lightweight and portable, making deploying and updating your applications easy.
  • Improved scalability: You can easily scale your applications up or down to meet demand.
  • Enhanced resource utilization: Containers share the underlying operating system, making them more efficient than traditional virtual machines.

Huawei Cloud CCE is one of the first Kubernetes service providers certified by the Cloud Native Computing Foundation (CNCF), which means it’s fully compatible with the native Kubernetes community version. Knowing that your applications will be portable across different Kubernetes environments gives you peace of mind.

Here are some of the key features of Huawei Cloud CCE:

  • Simple and easy to use: CCE is designed to be easy to use, even for those who are not familiar with Kubernetes.
  • Highly scalable: CCE can scale to support even the most demanding workloads.
  • Secure and reliable: CCE is built on a secure and reliable foundation, so you can be confident that your applications are safe.
  • Cost-effective: CCE is a cost-effective way to run containerized applications.

If you’re looking for a powerful and easy-to-use Kubernetes service, Huawei Cloud CCE is a great option. It’s a fully managed service, so you can focus on building and running your applications, while Huawei Cloud takes care of the underlying infrastructure.

Why do we need to manage our CCE service’s logs?

Managing your Kubernetes environment service logs is essential for several reasons, impacting both operational efficiency and application health:

Troubleshooting and debugging:

  • Identifying issues: Logs contain valuable information about application behavior, errors, and exceptions. Analyzing logs helps pinpoint the root cause of problems, enabling faster troubleshooting and resolution.
  • Understanding application behavior: Logs provide insights into application performance, resource consumption, and interactions with other services. This knowledge allows you to optimize settings, identify inefficiencies, and ensure smooth operation.
  • Investigating incidents: In case of incidents or outages, logs serve as a historical record of events, enabling you to understand the timeline and sequence of events leading to the issue. This facilitates incident response and post-mortem analysis.

Security and compliance:

  • Security monitoring: Logs can reveal suspicious activity, potential breaches, and unauthorized access attempts. Analyzing logs proactively helps safeguard your applications and environment.
  • Compliance adherence: Many regulations require keeping audit logs for a specific period. Effective log management ensures compliance with these regulations.
  • Threat detection and investigation: Logs provide clues about malicious activity like malware infections or data breaches. Monitoring and analyzing logs help detect and investigate such threats efficiently.

Performance optimization and resource management:

  • Resource utilization tracking: Logs inform you about resource consumption by different services and applications. This data helps identify resource bottlenecks, track scaling needs, and optimize resource allocation for better performance.
  • Performance benchmarking and analysis: Log data allows you to compare performance metrics over time, identify trends, and assess the impact of changes or optimizations.
  • Capacity planning and scaling decisions: Insights from logs guide you in making informed decisions about cluster capacity planning and scaling based on actual service resource demands.

Overall, managing your Kubernetes environment service logs empowers you with the knowledge and insights to:

  • Maintain application health and stability.
  • Improve operational efficiency and resource utilization.
  • Enhance security posture and compliance.
  • Optimize performance and troubleshoot issues effectively.

Therefore, implementing a centralized, well-defined log management strategy for your Kubernetes environment is crucial for achieving optimal performance, ensuring security, and managing your cluster effectively.

How to connect CCE and LTS services

  1. Log in or register to Huawei Cloud with this article.
  2. Create a CCE on Huawei Cloud
  3. LTS Service Configurations.

To analyze LTS logs, follow these steps:

  1. Go to the Huawei Cloud Console.
  2. Click Content > Services > LTS.
  3. Select your LTS instance.
  4. Click the Logs tab.
  5. Go to the log management page. Create log groups.
Huawei Cloud LTS

6. After the log group, create a log stream under the log group.

Huawei Cloud LTS

7. Then, select log ingestion.

Huawei Cloud LTS

8. Create an ingest. Select fixed log stream. Select your CCE cluster. Click next.

Huawei Cloud LTS

9. The created cluster will come automatically in the cce cluster option. After selecting your cluster, continue with the next button.

Huawei Cloud LTS

10. On this page, press the automatic button and wait for confirmation that all options will be updated automatically. once confirmed, continue with the next button.

Huawei Cloud LTS

11. On the next page you will see that your cluster is selected. No need to make any changes. You can continue with Next.

Huawei Cloud LTS

12. You can continue your collection by giving it a name. At the bottom, you also need to choose which log types to list. After completing the selections, you can continue.

Huawei Cloud LTS

13. There is no need to make any changes to the remaining two pages. If you have logs you have already received, you can parse them on this page. You can use JSON, regex, and more.

Huawei Cloud LTS

14. Accept it as default and skip the page.

Huawei Cloud LTS

15. When you get to the log ingest page, you should see the collection you have created.

Huawei Cloud LTS

16. Once you are sure of everything. go to the log management tab. from there select your log group and wait for the new page to open. on the page that opens you will see some log groups on the left side. you can check the logs by selecting the group in which you have created a collation. Don’t forget to update the duration of the logs on the top right.

Huawei Cloud LTS

Container Files

  1. As a separate example, let’s create a container file collation and check the logs.
Huawei Cloud LTS

2. First we create a log collection from log ingest as we did in the previous step.

Huawei Cloud LTS

3. In the same way, we select our Kubernetes cluster again.

Huawei Cloud LTS

4. This time we select the container file option.

Huawei Cloud LTS

5. After naming, we list some paths that are important in the Kubernetes.

Huawei Cloud LTS

6. In the collections we see the container file we just created.

Huawei Cloud LTS

7. We go to the log management page again and expect to see new logs there. this time we select container files from the list on the left.

Huawei Cloud LTS

More information.

Conclusion

In this article, you learned how to monitor Huawei Cloud CCE Service logs using the Huawei Cloud LTS service. LTS is a powerful tool for collecting, storing, and analyzing CCE Service logs. By using LTS, you can gain valuable insights for monitoring the health and performance of your applications, detecting security threats, and optimizing resource utilization.

References

--

--