Member-only story
I Built a Game for Data Visualization with Streaming Data
The new way of playing Pac-Man, powered by streaming data
Data visualization has always been a delightful area for me to work on as a data professional. Visualizing data is like an art. Many creative ideas sprout in this space. People transform boring number and lengthy summary into beautiful charts. The well-known subreddit Dataisbeautiful is one of those places.
Visualizing streaming data is something that has been introduced previously. You can take data from a live feed source and build a streaming ETL pipeline using tools like Apache Flink, Apache Spark, or Kafka Stream to perform data manipulation. Then dump the data into Elastic Search or Reddit to consume it.
If you have played with Kibana dashboard, you probably familiar with different chart types and have created a nice dashboard. With data streaming flys in, the Kibana dartboard can automatically refresh itself, and we can even put the dashboard on a TV and watch it all day long.
When I started a hackathon project during my years at Meetup, however, this visualization could have been more interactive, and…