https://community.cloudera.com/t5/Support-Questions/Zeppelin-pyspark-is-not-responding/m-p/185674#M147781 <P><A rel="user" href="https://community.cloudera.com/users/76162/khouloudlanderi.html" nodeid="76162">@Khouloud Landari</A> Do you see it stuck after those WARN Service SparkUI could not bind to port 4041? If that is the case I think the problem maybe is not able to start an application on yarn. What happens is spark2 pyspark launches a yarn application on your cluster and I think this is what is probably failing. </P><P>Try this command and let me know if this works:</P><PRE>SPARK_MAJOR_VERSION=2 pyspark --master local --verbose</PRE><P>Also I would advise you to check the Resource Manager logs. RM logs can be found on RM host under /var/log/hadoop-yarn</P><P>This will probably show what the problem is with yarn and why your zeppelin user is not able to start applications on the hadoop cluster.</P><P>HTH</P> Wed, 09 May 2018 00:59:34 GMT falbani 2018-05-09T00:59:34Z