Connecting your own Hadoop or Spark to Azure Data Lake Store
Amit Kulkarni
61

Very useful info, thanks for posting this. As an alternative to setting SPARK_DIST_CLASSPATH, setting the SPARK_CLASSPATH as below worked too.

export SPARK_CLASSPATH=$SPARK_CLASSPATH%:/home/xxxx/hadoop-3.0.0-alpha2/share/hadoop/tools/lib/azure-data-lake-store-sdk-2.0.11.jar:/home/xxxx/hadoop-3.0.0-alpha2/share/hadoop/tools/lib/hadoop-azure-datalake-3.0.0-alpha2.jar

Show your support

Clapping shows how much you appreciated Rajiv Cooray’s story.