Kafka is used for live streaming where N number of producers can write and N number of consumers can read on a Topic using the same group ID. Topics can be created in the Kafka server with as many partitions as required based on the traffic Each partition will have…

We can understand the shape of distribution using Mean is the athematic average of the group of numbers, mainly used to find the group's center. The median is the middle score or average of the middle score of the distribution. Mode is the most repeated value in the distribution. Types…

Fundamentals of Stream processing. Time Window is the interval of time between start and end. Using this filter one can collect data for analysis. Types of Window Streams Tumbling Windows: windows without gaps in between (end of first and the start of next). These windows won’t overlap. Example: If we consider 10 mins, it…

The data schema is the metadata about the data set or for a particular topic. This can be used to serialize the data at the consumer and Producer ends. In real-time, this can be done using serialization frameworks like Apache Avro. Example: Sample dataset {…

What's Kafka? Kafka is used for streaming Data (message units) from Producer(Data source ) to Consumer(Data utilizer) using brokers (storage that allows the consumer to fetch), and partitions (which will enable replications to avoid data loss). When the Message units or Data is huge we need to compress it first…