Guidelines on how to achieve real-time data and stream processing at scale

Meet Kafka

How we move the data becomes nearly as important as the data itself. Publish/subscribe messaging is a pattern that is characterized by the senders (publishers) of a piece of data (message) and consumers of the message that are loosely decoupled from each other. Pub/sub systems like Kafka are often designed with the help of an intermediary broker to orchestrate this pattern to enable diverse use cases.

Image for post
Image for post

A message is simply an array of bytes as far as Kafka is concerned, so the data contained within it does not have a specific format or meaning to Kafka. A message can have an optional bit of metadata, which is referred to as a key. Keys are used when messages are to be written to partitions in a more controlled manner. For efficiency, messages are written into Kafka in batches. A batch is just a collection of messages, all of which are being produced to the same topic and partition to avoid individual roundtrips across the network for each message. …

(Updated: May, 2020) How to perform at your peak with the help of mobile apps

Energy, not time, is the fundamental source of efficiency and high performance.

Image for post
Image for post
Photo by Peter Conlan on Unsplash

1. Use apps to remind you to take a break

Image for post
Image for post

The recovery is an integral part of sustaining high levels of energy and thus high performance. Have a life-sustaining rhythm and disengage at regular intervals i.e. rest every 90 to 120 minutes.

Image for post
Image for post
StandUp!: The Work Break Timer

2. Use apps to track hydration and water drinking

Image for post
Image for post

Drink enough water. Mild dehydration (fluid loss of 1–3%) can impair energy levels and mood, and lead to major reductions in memory and brain performance.

Image for post
Image for post
My Water: Drink Reminder

3. Use apps for sleep tracking

Image for post
Image for post

Take optimum amount of sleep. Having not enough sleep impairs your creativity, problem-solving, and memory that won’t help your productivity.

Image for post
Image for post
Pillow: Automatic Sleep Tracker

4. Use apps to track your workouts (gym, or home exercises)

Image for post
Image for post

Work out regularly, and incorporate small exercises into your everyday lives.

  • Exercise is shown to reduce stress, combat fatigue, improve performance and lead to fewer workday absences. …

In concurrent applications a thread might fail and die due to uncaught runtime exceptions even without noticing since the application may continue to work. Losing one consumer thread from a thread pool can be tolerable, but losing a single dispatcher thread can degrade application workflow.

There are four alternative approaches in Java to get notified when a task fails due to an exception, so that you can log or take some recovery action.

Proactive Approach

In the solution below, run() method of a thread is structured with try-catch block and if a task throws an unchecked exception, it allows the thread to die. …

About

Abdullah Ozturk - Blog

Software development engineer. Distributed systems enthusiast. #data, #iot, #mobile, #scalability, #cplusplus, #java https://github.com/aozturk

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store