Elasticsearch Ingestion Using AWS AMAZON MQ

fisheye
3 min readJan 2, 2024

--

Domain

FFC is able to offer services for Facilities, Verifiers, and Buyers that are signatories of SLCP. FFC is an industry innovator, and we are known for creating system solutions that are easy to use and lead to high adoption. This was validated by user feedback to SLCP during light ops pilot phase. FFC had the highest assessment completion rate and the highest ease of use feedback.

AWS AMAZON MQ Using RabbitMQ Features

Amazon MQ for RabbitMQ clusters, backed by Amazon EBS, use multi-AZ replication for high-availability and message durability. Data transfer for replication is included. Clusters are created behind a single-endpoint for high availability, simple management, and easy connection from your application.

  • Message Routing using RabbitMQ exchanges to queues

AMAZON MQ — Rabbit MQ Cluster

SERVICE

SLCP Start Service

Start the service

Please refer my article on Amazon MQ Service Cluster that describes this

SLCP MountService

Start the service

Please refer my article on Amazon MQ Service Cluster that describes this

AMAZON MQ CLUSTER Code to Listen to Q

SLCP Digester Service

The service gets Message from AMAZON MQ Cluster and is pipeline that continously listens to Q and pushes data to Elasticsearch

Elasticsearch VIEW — SEARCH DOCUMENTS

Lets query the data ingested to Elasticsearch by Above service

AWS AMAZON MQ AMQP CLUSTER SETUP

--

--