Logstash pipelines remote configuration and self-indexing

Logstash is a powerful data collection engine that integrates in the Elastic Stack (Elasticsearch — Logstash — Kibana). The goal of this article is to show you how to deploy a fully managed Logstash cluster incuding access to the logs and remotely configurable pipelines.

Previously the Elastic stack had two issues when it comes to a fully managed service: Kibana did not support Elasticsearch High Availabilty and Logstash Pipelines were not configurable remotely.