A Better CloudWatch Logs Viewer

Michael O'Brien
SenseDeep
Published in
3 min readApr 17, 2019
SenseDeep transforms CloudWatch

AWS CloudWatch Logs is a convenient, unified logging solution so you can collect and access all your operational and performance data in one place. It is cost-effective and flexible, however, the standard AWS log viewer is basic and slow.

As a developer, I need to monitor and scan the tail of application log files to quickly locate errors. I need to be able to scan for anomalous log entries and see sequences of log events in context. The AWS log console, while usable, is slow and is time-consuming to peruse log data. It takes up to 2–4 seconds to load page by page of event log data.

I want an extremely fast, simple log viewer that would allow me to instantly and easily see application errors and status. SenseDeep now has the result. A fast, fun-to-use, 100% browser-based CloudWatch Log viewer.

AWS CloudWatch Logs Viewer

The standard CloudWatch Logs viewer is simple and has some big limitations.

  • The CWL Viewer does not automatically aggregate log streams. CWL Logs are comprised of one or more log streams that are logically represent a single log. AWS will typically create new log streams when an existing stream gets over a certain size, or services are restarted, so streams tend to multiply. The streams are presented as discrete files that you need to examine one by one. While there is an API to aggregate events (filterLogEvents), CWL does not provide a unified view of a log file.
  • The Viewer does not automatically refresh the log view when new events arrive. The CWL Log viewer provides a static paged view of events. You can click on a link to pull more events, but the display will not automatically display new log events without manual intervention.
  • The Viewer is slow to load log events and is slow refresh (page to page). Each click can take 2–5 seconds to refresh the next page or batch of log events. This makes scrolling through many log events very tedious and impractical as a way to scan for log errors.
  • The Viewer does not understand events that contain JSON records. In the log view, you can click on an event and have expanded inline as JSON literal, but CWL does not understand the JSON structure of the event record and does not convert these into top-level fields that can be displayed as table headings.
  • SenseDeep addresses these CWL shortcomings and enables developers to quickly and easily gain insights into their application logs.
  • SenseDeep has an awesome AWS CloudWatch Logs viewer that runs exceptionally fast.
Rapid Search

SenseDeep aggregates logs from multiple AWS log streams into a single, uniform view for analysis. It has real-time live-tailing of events, smooth scrolling, rapid navigation and instant queries. SenseDeep supports infinite scrolling through log data with powerful full text searching.

Key Features

Here are the key features of SenseDeep:

  • Transparent downloading of logs
  • Automatic aggregation of log streams
  • Live updating of events in the background
  • Infinite smooth scrolling
  • Search and filter events with full text queries
  • Cache log data limited by size or date range
  • View and query events by date range
  • Fast goto event by date and time
  • JSON Smart — extracts fields from event data
  • Save multiple log views
  • Bookmark favorite views
  • Free evaluation (no credit card required)

Getting Started

There is nothing to install. Just navigate your browser to:

https://app.sensedeep.com/

To learn more about SenseDeep and how to use the App or licensing, goto the SenseDeep web site at:

https://www.sensedeep.com

References

Originally published at https://www.sensedeep.com on April 17, 2019.

--

--