Sitemap
Data Engineering Space

Data Engineering Space is a Medium.com publication that provides high-quality content and resources related to data engineering. Our website feature articles, tutorials, and educational content that provide insights into best practices for data engineering.

Member-only story

I Built a Game for Data Visualization with Streaming Data

The new way of playing Pac-Man, powered by streaming data

5 min readFeb 11, 2023

--

Photo by George Flowers on Unsplash

Data visualization has always been a delightful area for me to work on as a data professional. Visualizing data is like an art. Many creative ideas sprout in this space. People transform boring number and lengthy summary into beautiful charts. The well-known subreddit Dataisbeautiful is one of those places.

Visualizing streaming data is something that has been introduced previously. You can take data from a live feed source and build a streaming ETL pipeline using tools like Apache Flink, Apache Spark, or Kafka Stream to perform data manipulation. Then dump the data into Elastic Search or Reddit to consume it.

If you have played with Kibana dashboard, you probably familiar with different chart types and have created a nice dashboard. With data streaming flys in, the Kibana dartboard can automatically refresh itself, and we can even put the dashboard on a TV and watch it all day long.

Kibana Dashboard with Data Streaming Live Updates| Image By Author

When I started a hackathon project during my years at Meetup, however, this visualization could have been more interactive, and…

--

--

Data Engineering Space
Data Engineering Space

Published in Data Engineering Space

Data Engineering Space is a Medium.com publication that provides high-quality content and resources related to data engineering. Our website feature articles, tutorials, and educational content that provide insights into best practices for data engineering.

Chengzhi Zhao
Chengzhi Zhao

Written by Chengzhi Zhao

Data Engineer | Data Content Creator | Contributor of Airflow, Flink | Blog chengzhizhao.com

No responses yet