Sign in Get started

Tagged in

Spark

Coiled

Coiled helps you use Python on the cloud easily and efficiently.

More information

Followers

105

Elsewhere

More, on Medium

Spark

Coiled in Coiled

Relative difference between Dask vs. PySpark on 10 TB scale running on a cluster with about 5 TB of memory and 1280 CPUs. Orange represents queries where Dask is faster, blue where PySpark is faster, and grey where PySpark failed.

Spark vs. Dask

If you want to run Python code at scale today you have serveral options. Arguably, the…