https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140135#M35387 <P>I ended up looking the livy.log file for the actual error message. My user that i was trying to run as did not have a home directory in HDFS. So created a home dir with proper permissions and got it working.</P> Fri, 17 Feb 2017 20:38:15 GMT azeltov 2017-02-17T20:38:15Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140128#M35380 <P>Greetings Experts,</P><P> I am trying to run LivyServer in zeppelin in HDP 2.5TP sandbox, however my interpreter keeps failing. I tried %livy.sparkr and %livy.pyspark all getting same exceptions. See error messages below from the livy log file:</P><PRE>LivyPySparkInterpreter while interpret java.lang.Exception: Cannot start pyspark INFO [2016-07-18 22:20:23,102] ({Thread-0} RemoteInterpreterServer.java[run]:81) - Starting remote interpreter server on port 41012 INFO [2016-07-18 22:20:23,420] ({pool-1-thread-4} RemoteInterpreterServer.java[createInterpreter]:169) - Instantiate interpreter org.apache.zeppelin.livy.LivySparkR Interpreter INFO [2016-07-18 22:20:23,457] ({pool-1-thread-4} RemoteInterpreterServer.java[createInterpreter]:169) - Instantiate interpreter org.apache.zeppelin.livy.LivySparkI nterpreter INFO [2016-07-18 22:20:23,461] ({pool-1-thread-4} RemoteInterpreterServer.java[createInterpreter]:169) - Instantiate interpreter org.apache.zeppelin.livy.LivyPySpar kInterpreter INFO [2016-07-18 22:20:23,462] ({pool-1-thread-4} RemoteInterpreterServer.java[createInterpreter]:169) - Instantiate interpreter org.apache.zeppelin.livy.LivySparkS QLInterpreter INFO [2016-07-18 22:20:23,505] ({pool-2-thread-2} SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1468880423503 started by scheduler org.apache.zepp elin.livy.LivySparkRInterpreter1573372211 ERROR [2016-07-18 22:20:24,722] ({pool-2-thread-2} LivyHelper.java[createSession]:89) - sessionId:0.0 state is starting ERROR [2016-07-18 22:20:25,754] ({pool-2-thread-2} LivyHelper.java[createSession]:89) - sessionId:0.0 state is starting ERROR [2016-07-18 22:20:26,769] ({pool-2-thread-2} LivyHelper.java[createSession]:89) - sessionId:0.0 state is starting ERROR [2016-07-18 22:20:27,784] ({pool-2-thread-2} LivyHelper.java[createSession]:89) - sessionId:0.0 state is dead ERROR [2016-07-18 22:20:28,799] ({pool-2-thread-2} LivyHelper.java[createSession]:89) - sessionId:0.0 state is dead ERROR [2016-07-18 22:20:29,814] ({pool-2-thread-2} LivyHelper.java[createSession]:89) - sessionId:0.0 state is dead .... .... ERROR [2016-07-18 22:41:10,602] ({pool-2-thread-6} LivyHelper.java[createSession]:89) - sessionId:2.0 state is starting ERROR [2016-07-18 22:41:11,609] ({pool-2-thread-6} LivyHelper.java[createSession]:114) - Error getting session for user within 60Sec. ERROR [2016-07-18 22:41:11,609] ({pool-2-thread-6} LivyHelper.java[createSession]:120) - Error getting session for user java.lang.Exception: Cannot start pyspark. at org.apache.zeppelin.livy.LivyHelper.createSession(LivyHelper.java:115) at org.apache.zeppelin.livy.LivyPySparkInterpreter.interpret(LivyPySparkInterpreter.java:63) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:341) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [2016-07-18 22:41:11,610] ({pool-2-thread-6} LivyPySparkInterpreter.java[interpret]:70) - Exception in LivyPySparkInterpreter while interpret java.lang.Exception: Cannot start pyspark. at org.apache.zeppelin.livy.LivyHelper.createSession(LivyHelper.java:115) at org.apache.zeppelin.livy.LivyPySparkInterpreter.interpret(LivyPySparkInterpreter.java:63) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:341) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) INFO [2016-07-18 22:41:11,611] ({pool-2-thread-6} SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1468881610078 finished by scheduler org.apache.ze ppelin.livy.LivyPySparkInterpreter1321637285 </PRE> Thu, 21 Jul 2016 05:35:03 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140128#M35380 azeltov 2016-07-21T05:35:03Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140129#M35381 <P><A rel="user" href="https://community.cloudera.com/users/325/azeltov.html" nodeid="325">@azeltov</A> </P><P>Did you resolve your problem? I am facing the same.</P> Mon, 26 Sep 2016 16:05:07 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140129#M35381 frank93 2016-09-26T16:05:07Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140130#M35382 <P><A rel="user" href="https://community.cloudera.com/users/325/azeltov.html" nodeid="325">@azeltov</A> , <A rel="user" href="https://community.cloudera.com/users/3241/frank93.html" nodeid="3241">@Edgar Daeds</A></P><P>When we run anything from Livy server, it tries to connect to Resource manager at 8032 port. But in Sandbox, the value of yarn.resourcemanager.address is 8050 so it waits for 10 tries and then fails.</P><P>Go to Ambari-&gt;Yarn-&gt;Configs. Search for yarn.resourcemanager.address and change it to 8032. Restart YARN and then try running %livy.pyspark.</P> Thu, 03 Nov 2016 02:23:42 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140130#M35382 mrizvi 2016-11-03T02:23:42Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140131#M35383 <P><A rel="user" href="https://community.cloudera.com/users/10331/mrizvi.html" nodeid="10331">@mrizvi</A> </P><P>Actually on my cluster the value of yarn.resourcemanager.address is also 8050 (by default). I did not try your solution yet, but thank you for the answer. I am going to let you know if that works.</P> Thu, 03 Nov 2016 14:38:39 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140131#M35383 frank93 2016-11-03T14:38:39Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140132#M35384 <P>I am also facing this. <A rel="user" href="https://community.cloudera.com/users/3241/frank93.html" nodeid="3241">@Edgar Daeds</A> did you get it working?</P><P>Thanks.</P> Tue, 24 Jan 2017 22:51:13 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140132#M35384 smartninja723 2017-01-24T22:51:13Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140133#M35385 <P>I have seen this error for my customer. Issue was with memory footprint on the node hosting Zeppelin/Livy. </P><P>Free memory was 1GB. This was since livy had many dead session which were not releasing memory. Deleting livy sessions helped increasing free memory. YOu can use livy rest api to view sessions and delete dead sessions. </P> Thu, 09 Feb 2017 04:04:31 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140133#M35385 PranayV 2017-02-09T04:04:31Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140134#M35386 <P>Hi <A rel="user" href="https://community.cloudera.com/users/325/azeltov.html" nodeid="325">@azeltov</A></P><P>Can you restart the interpreter and give it a try again.</P><P>The session idles out leading to such errors.</P><P>Is your cluster kerberized?</P> Fri, 17 Feb 2017 05:07:56 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140134#M35386 ddharam 2017-02-17T05:07:56Z https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140135#M35387 <P>I ended up looking the livy.log file for the actual error message. My user that i was trying to run as did not have a home directory in HDFS. So created a home dir with proper permissions and got it working.</P> Fri, 17 Feb 2017 20:38:15 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/LivyServer-exception/m-p/140135#M35387 azeltov 2017-02-17T20:38:15Z