Open in app
Home
Notifications
Lists
Stories

Write
Vikas Singh
Vikas Singh

Home

Aug 9, 2017

How to spread receivers over worker hosts evenly in Spark streaming

How to spread receivers over worker hosts evenly in Spark streaming In Spark Streaming, you can spawn multiple receivers to increase parallelism, e.g., such that each receiver reads from one of the partitions in Kafka. Then you combine the resulting streams and process them by batches. …

Scala

4 min read

Vikas Singh

Vikas Singh

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Knowable