Using the ambassador pattern for reliable pipes-and-filters text processing

Overview of the text exploration pipeline from the previous article.

Definition

Diagram demonstrating the use of the ambassador container pattern for service sharding
  • Continuously, the ambassador container listens for messages on an input task queue.
  • When a message is received from the queue, the ambassador converts it into a web request to the text processing container and executes the request.
  • The ambassador container waits for the response from the text processing service and on receipt sends the appropriate messages to notify one or more downstream task queues of the result.
Diagram showing an ambassador container for injecting queues into the text processing pipeline

Implementation

Deployment

Conclusion

Resources

--

--

--

Senior software engineer at Microsoft. https://justamouse.com

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

ScanIt: The Open Source CamScanner Alternative

Building Blocks for Site Reliability Engineering

Coding Hardware and Hardware Description Languages

Dealing with datetimes like a pro in Python

6 Things to Consider in Analysis Phase of a Project

Association, Aggregation, Composition — Python

An alternative approach to rate limiting

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Clemens Wolff

Clemens Wolff

Senior software engineer at Microsoft. https://justamouse.com

More from Medium

Order Query Chatbot using GCP Dialogflow

Experience Of Google Auto ML — Cloud NLP

E-commerce Product Recommendation System (Content Based)

Using Google Maps Places API to “validate” locations in a conversation with a virtual agent