ElasticSearch Monitoring and Maintenance tools research
This list contains information about tools I found, please feel free to provide information about another tools and services in comments and I will extend this list.
Tools
Marvel
https://www.elastic.co/products/marvel
Your Cluster Health at a Glance
Marvel’s overview dashboard provides full details on the health of your cluster, including cluster-wide metrics, and events such as shard relocation and recovery.
Metrics in Context
Marvel collects cluster-wide events such as index creation, search rate, shard activity, and indexing latency. Events are displayed either alongside their metrics, allowing you to see both cause and effect in the same place at the same time, or on a dedicated dashboard so you can dive deeply into a particular node or index.
Real-Time and Historical Analysis
Marvel’s dedicated dashboards allow for in-depth analysis of a wide collection of metrics, ranging from machine level information to details of Elasticsearch internals. Marvel also stores your historical data, allowing you to dive into past issues just as easily as you see your cluster’s performance in real time.
Take Control with Multicluster Support
You asked, we’ve answered. Marvel simplifies your workflow by allowing one centralized monitoring cluster to record and track the health and performance of multiple production Elasticsearch clusters.
kopf
https://github.com/lmenezes/elasticsearch-kopf/ — Open source and has MIT licence.
kopf is a simple web administration tool for elasticsearch written in JavaScript + AngularJS + jQuery + Twitter bootstrap.
It offers an easy way of performing common tasks on an elasticsearch cluster. Not every single API is covered by this plugin, but it does offer a REST client which allows you to explore the full potential of the ElasticSearch API.
elastichq
Real-Time Data
Actively polls ElasticSearch clusters every 5 seconds, refreshing the screen with the most recent status information.
Monitoring Clusters
Stay on top of your cluster health in real-time with top-level overview data and drill-down fine-grained stats.
Node Monitoring
Actively monitor individual nodes for changes in performance from I/O to Memory usage. It’s all here.
Indices Management
Refresh, Optimize, Delete, and View Indices Metrics with a simple click of a button… Shard and Alias information included.
Search and Query
Flexible Query feature makes it easy to search your Index or Indices.
REST API UI
Stop fighting cURL, REST APIs, and JSON formats. The powerful REST UI does it all for you.
Diagnostics Checkup
ElasticHQ analyzes key metrics across all of your nodes, and actively provides helpful hints and solutions.
Device Friendly
ElasticHQ looks and behaves great in the latest desktop browsers as well as in tablet and smartphone browsers.
No Software
HQ runs in your browser, allowing you to monitor your ElasticSearch cluster without any software to install.
Managing Type Mappings
View the structure of your documents in one easy-to-read user interface.
elasticsearch-inquisitor
https://github.com/polyfractal/elasticsearch-inquisitor
Site plugin for Elasticsearch to help understand and debug queries.
Sematext
Curator
https://github.com/elastic/curator
Like a museum curator manages the exhibits and collections on display, Elasticsearch Curator helps you curate, or manage your indices.
https://postmarkapp.com/blog/tools-we-use-curator-for-elasticsearch
elasticsearch-dump
https://github.com/taskrabbit/elasticsearch-dump
Import and export tools for elasticsearch
Knapsack
https://github.com/jprante/elasticsearch-knapsack
Knapsack plugin is an import/export tool for Elasticsearch
elasticsearch-tools
https://github.com/skratchdot/elasticsearch-tools
After installing, you will have access to the following command line tools:
Exporting
es-export-bulk
es-export-mappings
es-export-settings
es-export-aliases
Importing
es-import-bulk
es-import-mappings
es-import-settings
es-import-aliases
elasticsearch-cloud-aws
Backup to S3.
https://github.com/elastic/elasticsearch-cloud-aws
https://github.com/elastic/elasticsearch-cloud-aws#s3-repository
References
Administration, Monitoring, and Deployment
https://www.elastic.co/guide/en/elasticsearch/guide/master/administration.html
Monitoring — https://www.elastic.co/guide/en/elasticsearch/guide/master/cluster-admin.html
Backing Up — https://www.elastic.co/guide/en/elasticsearch/guide/master/backing-up-your-cluster.html
10 Elasticsearch metrics to watch
https://www.oreilly.com/ideas/10-elasticsearch-metrics-to-watch
Signalfx
https://signalfx.com/how-we-monitor-and-run-elasticsearch-at-scale/
