Terminology:

Container: AZDL (Azure Data Lake) equivalent of file explorer

Blob: AZDL (Azure Data Lake) equivalent of a file

Example 1: Read a CSV file from an Azure Data Lake Store Gen2 store as an Apache Spark DataFrame

  • account_name: The storage account name
  • relative_path
  • Replace “Your path” with the relative path of where the file is stored
  • adls_path
  • The adls_path is defined by passing through the above parameters.

Example 2: Read a CSV file from Azure Storage Account as a Spark DataFrame.

--

--

Samueldavidwinter

Samueldavidwinter

Passionate data engineer who loves helping others & =playing a small part in humanities capability to improve lives & understand the glorious universe. Much <3