word2vec on Databricks

Example that processes a text corpus with word2vec in Spark on Databricks.

Parallel Processing with pysparkling

Introducing parallel processing in pysparkling and benchmarking…

pysparkling

Originally published on May 29, 2015.

pysparkling is a native Python implementation of the interface provided by Spark’s RDDs. In Spark, RDDs are Resilient Distributed Datasets. An RDD instance provides convenient access to the partitions of data that are distributed on a cluster…

Wildcardians on Twitter

Twitter network graph from few API calls.

Collaborative Statistical Modeling

A poster made for the opening of NYU’s Center for Data Science.

Databench v0.4

Originally published on September 22, 2016.

pysparkling Talks

Collection of links to talks.