PySpark: unit, integration and end-to-end tests.

Introduction