Modern day testing of applications happens both in the CI pipelines and also in production, that is if you are following the principles of chaos engineering. Chaos engineering has gotten into the lives of DevOps so much so that it has become part of the application development process. We at MayaData use Litmus to practice chaos engineering for validating each commit of OpenEBS against a few Prometheus releases. We also extend the same testing to do some real-world chaos engineering on our production clusters where Prometheus is being used for monitoring our GitLab production system.
In this article, I will describe how OpenEBS is used as persistent storage for Prometheus and discuss how we verify the stability of such a deployment. Before going into the details, let us see what is Litmus, why OpenEBS is used as TSDB for Prometheus.
What is Litmus?
LITMUS — An open source framework for chaos engineering based qualification of Kubernetes environments running stateful applications. For a good introduction to Litmus and how to …