Hi Gary. First of all, thanks for the article — it will definitely help me a lot in the future. At least when I’m able to start the docker stack based on your description. I can’t deploy the stack even though I have followed the guide:
1) Cloned your git repository
2) Created ‘data/postgres’ in a $HOME directory (‘home/user’ in my case)
3) Executed ‘sudo docker stack deploy -c stack.yml pyspark’ from ‘/pyspark-setup-demo’ directory.

When I run ‘sudo docker ps I can’t see any processes running and ‘sudo docker stack ps pyspark —no-trunc’ returns a bunch of records with an error saying something like ‘invalid mount config for type “bind” mount source path not exist: /work’.

What am I missing here?