Amazon CloudWatch generative AI for Logs & Metrics Insights

Lukáš Cimpl
Life at Apollo Division
4 min readMar 7, 2024

Amazon CloudWatch service supplemented its essential functionality with AI-powered natural language generation of queries for analyzing logs and metrics data. If you utilize CloudWatch for your AWS assignments, you will discover the power of AI capabilities to support your daily activities. Using AI features has the potential to accelerate key work processes and simplify tasks for all individuals involved. In this article, I will explore the functions of generative AI in CloudWatch.

Generative AI in Amazon CloudWatch (source: aws.amazon.com)
Generative AI in Amazon CloudWatch

CloudWatch is a service that monitors applications, responds to performance changes, optimizes resource use, and provides insights into operational health. CloudWatch collects and visualizes real-time logs, metrics, and event data in automated dashboards to channel infrastructure and application maintenance.

Source: https://aws.amazon.com/cloudwatch/

Most people working in the IT field have already heard about the notable possibilities given by generative AI. In short, it is an artificial intelligence capable of generating text, images, videos, code fragments, or other data. Typically, the whole process finishes as a response to a user prompt. This domain often uses very complex models based on deep neural networks.

Did you know that Amazon offers services for boosting productivity, building differentiated experiences, and innovating faster with generative AI for every business from startups to enterprises? This is usable for reinventing customer experiences, enhancing productivity, and accelerating growth.

Source: https://aws.amazon.com/generative-ai/

CloudWatch Logs Insights enables users to search and investigate log data using purpose-built queries. It supports us in working with logs, making it easier to solve typical operational issues without time-consuming barriers.

Generative AI in Logs Insights can be used to auto-generate queries from a prompt without knowledge of the query language itself. It has the eminent potential to speed up log analysis activities and save time during research.

Query Generator in Logs Insights
Query Generator in Logs Insights
Query Generator in Logs Insights — Animation
Query Generator in Logs Insights — Animation

This feature is in preview release in the US East (N. Virginia) and US West (Oregon) for CloudWatch Logs and is subject to change.

Source: Amazon CloudWatch Logs — User Guide

CloudWatch Metrics Insights allows users to analyze data metrics at scale using a SQL-based query engine. Among other options, it empowers us to identify potential trends and patterns, aggregate metrics, and set alarms.

Generative AI in Metrics Insights offers the same benefits as the variant in Logs Insights. In addition to generating queries, it produces a line-by-line query explanation and helps to refine existing queries in Builder or Editor.

Query Generator in Metrics Insights — Builder
Query Generator in Metrics Insights — Builder
Query Generator in Metrics Insights
Query Generator in Metrics Insights — Editor

This feature is in preview release in the US East (N. Virginia) and US West (Oregon) for CloudWatch and is subject to change.

Source: Amazon CloudWatch — User Guide

There are other AI capabilities in the Amazon CloudWatch service beyond the AI-powered natural language query generation in Metrics Insights or Logs Insights. One of these possibilities is CloudWatch anomaly detection, which utilizes many complex statistical & machine-learning algorithms to produce an anomaly detection model for our logs and metrics.

Anomaly Detection in Logs
Anomaly Detection in Logs

This Medium article has been prepared as part of my research into the new artificial intelligence features used in Amazon CloudWatch. From the AWS side, it is one of the steps into the world of AI. What about your experience with AI capabilities in AWS? Have you come across any functionalities that would be beneficial to recommend to others?

If you would like to find out more information about this popular topic, you can check out the following official AWS resources:

We are ACTUM Digital and this piece was written by Lukáš Cimpl, Senior QA Engineer of Apollo Division. Feel free to get in touch.

--

--