Broadcast variables in Spark, how and when to use them?

As documentation for Spark Broadcast variables states, they are immutable shared variable which are cached on each worker nodes on a Spark cluster. In this blog, we will demonstrate a simple use case of broadcast variables.

Testing grammar using ANTLR4 TestRig (Grun)

“Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live.”
-Martin Golding

How to write grammar for your own language with ANTLR .? (Part -I) : Setting up the Environment( Intellij with ANTLR)

Ever wondered about this question that actually how can we write our own language?

UDF overloading in spark

UDF are User Defined Function which are register with hive context to use custom functions in spark SQL queries. For example if you want to prepend some string in any other string or column then you can create a following UDF

def addSymbol(input:String…

KnolX: Unit Testing of Spark Applications

Knoldus organized a KnolX session on Wednesday, 13 April 2016. In this KnolX session, we explored the different methods of writing unit tests for Spark applications. This session also talks about how unit testing of Spark applications is done, as well as…

Integration Test Configuration in Play Framework

A few days ago I’ve come across a problem while writing integration testing of my play application. My need was like to run unit and Integration test separately, in a normal sbt project, it’s easy to configure it, but I couldn’t find proper…

KnolX: Introduction to TitanDB

Knoldus organized a KnolX session on Wednesday, 27 April 2016. In this KnolX session we discussed the key features and advantages offered by TitanDB for developing our applications.

Is Flink the shiny(err..) toy on the block?

If you are following the Big Data space especially from a Scala Space perspective then you would have noticed a troll of blogs, tweets and more blogs comparing the two. The two being Spark and Flink. That said, you would also find comparing these two…

Ui made easy for Angular Js Developers

Angular Js developers sometimes feels bit confused when it comes to designing the UI, but there are some very useful and free directives are available in market that make the flow quite easy and interesting.

Unit Testing and Coverage for AngularJS

Hi all,

Knoldus has organized a one hour session on 20th Dec 2016 at 5:00 PM. The topic was Unit Testing and Coverage for AngularJS. Many people have joined and enjoyed the session. I am going to share the slides here. Please let me…