How to log in Apache Spark, a functional approach
Nicolas A Perez
217
Hi, thank you for the post! I think you are not comparing the same thing, though. In the end, in your example there is no logging involved in the workers but in the driver program (you are logging RDD transformations in the driver program, not single operations carried out by the workers). I wonder if this is still achievable with the writer monad.