Essential concepts in Spark

Photo by Warren Wong on Unsplash

The Apache Spark core is the basic execution engine of the Spark platform. All other functions are built on this engine. It not only provides memory computing functions to improve speed but also provides a general execution model to support various applications. In addition, users can use Java, Scala, and Python API to develop applications. Spark core is built on a unified abstract RDD, which allows various components of Spark to be…