Creating an Elasticsearch Dashboard — Ingesting Data with Python

A Step-by-Step Guide to Build a Data Ingestion Pipeline to Elasticsearch

Andrea Valenzuela
DataBites

--

Self-made image.

In the age of Big Data, we are constantly seeking ways to turn raw data into meaningful insights. Nevertheless, with the vast amount of data pouring in from various sources, ingesting and aggregating this information in useful Dashboards is a daunting task.

In any successful data strategy, Data Ingestion is the crucial first step. By efficiently collecting and organizing data, one can make sure it is available in any of the steps of the analysis. From data cleaning to data visualization!

In the article What’s Behind Elasticsearch? — Unlocking the Power of Data Visualization, we discussed the concept of a Dashboard, the different platforms available to build one, and Elasticsearch as a versatile platform for this purpose.

In this article, we will explore the process of data ingestion to Elasticsearch with Python, so that you can make your data available in the visualization platform and have it ready for building your dashboard.

Let’s go step by step!

Our Sample Dataset

Resuming with the first article, Data Ingestion is the process of collecting…

--

--

Andrea Valenzuela
DataBites

Software developer and data scientist - CERN🚀 | Writing about Computing, Data and Tech👩🏻‍💻 | Sharing tricks and experiences✨