Apache Flink

The distributed stream processing engine

What is Apache Flink ?

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Flink has been designed to run in all common cluster environments, perform computations at in-memory speed and at any scale.

More info

Below article gives a gist on streaming engine concepts and choices available.

Selecting the Right streaming Engine for your Data Pipeline

Below is an article which compares all these frameworks in great detail.

Spark Streaming vs Flink vs Storm vs Kafka Streams vs Samza : Choose Your Stream Processing…

Slideshow

The below slides discuss in detail from big data to emergence of big data frameworks such as spark and Flink. The example using Datastream API and Dataset API. Explains the windowing in flink and ends with use-cases.

Resources

1. The Offical Documentation — https://ci.apache.org/projects/flink/flink-docs-release-1.11/
2. DataStream API- https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/datastream_api.html
3. Slides — https://www.slideshare.net/pranaykumar82/apache-flink-239766010