An SQL Editor for Apache Spark SQL with Livy

Romain Rigaux
Apr 27, 2020 · 2 min read

December 2020 Update: Spark SQL queries with the SparkSql Thrift Server instead of Livy

Spark SQL

Spark SQL is convenient for embedding clean data querying logic within your Spark apps. Hue brings an Editor so that it is easier to develop your SQL snippets.

As detailed in the documentation, Spark SQL comes with different connectors. Here we will just show with Livy.

Apache Livy provides a bridge to a running Spark interpreter so that SQL, pyspark and scala snippets can be…