What happens when you submit a Spark application?

spark-submit –master <Spark master URL> --driver-memory 1g --executor-memory 1g --executor-cores 2 --py-files file1.py,file2.py,file3.zip,file4.egg wordByExample.py
Spark Architecture
Spark Architecture Image (bigdatainterview.com)
Spark Architecture

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store