Running PySpark with Cassandra in Jupyter
Amir Ziai
31

Hi Amir,

Thanks for your post! Quick question; when I try to compile pyspark-cassandra I get:
 31 errors found
[error] (compile:compileIncremental) Compilation failed

And these errors include things like:
/Users/Ash/Projects/BigDataPipeline/spark/pyspark-cassandra/src/main/scala/pyspark_cassandra/PythonHelper.scala:84: value unpickle is not a member of org.apache.spark.rdd.RDD[Array[Byte]]
[error] rdd.rdd.unpickle().saveToCassandra(keyspace, table, selectedColumns, conf)

As the compiling fails, no jars are generated. Can you think why this is happening?

Thanks again -

One clap, two clap, three clap, forty?

By clapping more or less, you can signal to us which stories really stand out.