Introduction to Accumulators : Apache Spark

Whats the Problem : Function like map() , filter() can use variables defined outside them in the driver program but each task running on the cluster gets a new copy of each variable, and updates from these copies are not propagated back to the driver.

Email spam detection using apache spark mllib

In this blog we will see the real use case of spark mllib that is email spam detection. With the help of using the apache spark mllib component we will detect that email will goes in spam folder or primary folder.

Maven Plugins for Scala Code Quality

SBT is an excellent tool for Scala and there are many plugins available for SBT to improve and measure the code quality of our Scala code. Sometime you may require to use only the Maven as a build tool and most of the popular plugins available in SBT for Scala are…

Jmeter Data Extraction from File

When we talking about Performance Testing, Some time we faces the scenario like we have to extract data from file. Extraction data from file is very important part of performance testing.

Another Apache Flink tutorial, following Hortonworks’ Big Data series

Background

A couple of weeks back, I was discussing with a friend of mine, on the topic of training materials on Apache Spark, available online. Of the couple of sites that I…

SBT and Github commands using Linux Cronjob for github project

When i was in the middle of my project I encountered a challenge to run sbt commands and github commands for my cloned project at regular intervals(say after every hour or two). When I looked up to the problem it seemed a…