https://community.cloudera.com/t5/Support-Questions/Spark-History-Server-fails-to-start-with-new-installation/m-p/312809#M225277 <P><a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/86162">@PrernaU</a>&nbsp;<BR />There are 2 issues here the home directory for spark&nbsp; doesn't exist and a permission issue&nbsp; switch to the superuser&nbsp; i.e hdfs or whatever and run the below command</P><P>&nbsp;</P><LI-CODE lang="markup">$ hdfs dfs -mkdir /user/spark</LI-CODE><P>Then change the ownership&nbsp;</P><LI-CODE lang="markup">$ hdfs dfs -chown spark:spark /user/spark</LI-CODE><P>Make sure the permissions are correct for spark&nbsp;</P><P>&nbsp;You should now be able to restart successfully spark&nbsp;</P><P>&nbsp;</P><P>Hope that helps</P><P>&nbsp;</P> Wed, 10 Mar 2021 20:36:44 GMT jackass 2021-03-10T20:36:44Z