Open in app
Sign inGet started
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

Stream Processing in pysparkling

pysparkling is a native Python implementation of PySpark. Stream processing is considered to be one of the most important features of Spark. PySpark provides a Python interface to Spark’s StreamingContext and supports consuming from updating HDFS folders and TCP sockets…

Read more…
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

Databench v0.4

Originally published on September 22, 2016.

Read more…
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

word2vec on Databricks

Example that processes a text corpus with word2vec in Spark on Databricks.

Read more…
3 responses
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

Parallel Processing with pysparkling

Introducing parallel processing in pysparkling and benchmarking…

Read more…
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

pysparkling Talks

Collection of links to talks.

Read more…
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

pysparkling

Originally published on May 29, 2015.

pysparkling is a native Python implementation of the interface provided by Spark’s RDDs. In Spark, RDDs are Resilient Distributed Datasets. An RDD instance provides convenient access to the partitions of data that are distributed on a cluster…

Read more…
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

Wildcardians on Twitter

Twitter network graph from few API calls.

Read more…
Go to the profile of Sven Kreiss
Sven Kreiss in trivial.io

Collaborative Statistical Modeling

A poster made for the opening of NYU’s Center for Data Science.

Read more…
About
trivial.io
trivial.io
Blog by Sven Kreiss
More information
Followers
17
Elsewhere