Published in Towards Data Science·Oct 4, 2018Watermarking in Spark Structured StreamingHandling late arriving events is a crucial functionality for Stream Processing Engines. A solution to this problem is the concept of watermarking. And it is supported by the Structured Streaming API since Spark 2.1. What is a Watermark? Watermarking is a useful method which helps a Stream Processing Engine to deal with lateness. Basically…Stream Processing3 min read
Published in Towards Data Science·Sep 10, 2018Bookreview: ‘Streaming Data’ by Andrew G. PsaltisStream processing systems are constantly gaining attention and adoption in industry in recent years, because of the need to process (big-)data more quickly. To accomplish this, a sequence of digital signals, the so-called data stream, is processed and analyzed in order to produce (near) real-time insights. The book ‘Streaming Data’…Big Data6 min read
Published in Towards Data Science·Mar 18, 2018Review of Deeplearning.ai CoursesRecently I’ve finished the last course of Andrew Ng’s deeplearning.ai specialization on Coursera, so I want to share my thoughts and experiences in taking this set of courses. …Machine Learning14 min read
Jun 8, 2017Is an event worth attending? A simple prototypeA few weeks ago, I worked on a new project structure for quick prototypes developed with the PyData Stack. So I wanted to try this boilerplate out in a small pet project, to discover how it works and what needs to be adjusted. As no better topic has occured, I…Machine Learning2 min read
Mar 12, 2017Notes from PyConSK 2017Notes, thoughts and conclusions from talks and workshops at PyConSK 11./12.03.2017: SATURDAY What makes Silicon Valley software developers special, Pavel Serbajlo (Exponea CTO): SV ~6% of us economy. Presents Infos abt SV and core attitudes & mindset of biz there: Sharing infos abt challenges even btw direct competitors. Openess and diversity…Python4 min read
