Well, now we have completely new problem to solve.
Nicolas A Perez
21

Thanks. This resolved my problem. I have one more doubt like. When I am doing spark submit, I see that a sparks.log file is getting created at the location mentioned in log4j properties. 
Will there be two different files (spark.log and sparkU.log) or only one log file at the master?
I don’t have a cluster so I am testing this on a stand alone machine. 
In the previous post we could see two different log files: one for spark logs and one for user logs. Will this case also produce 2 different log files or all the logs(spark+user) will be one log file only?
Thanks in advance

Show your support

Clapping shows how much you appreciated Mridula Bvs’s story.