Reply
Contributor
Posts: 26
Registered: ‎12-30-2015

livy running occured exception

I am new on Livy .

When I have execute 'http://lcoalhost:8998/sessions' ,it respons logs like bellow:

 

```

16/04/19 16:10:12 INFO InteractiveSession: Creating LivyClient for sessionId: 2
16/04/19 16:10:12 WARN RSCConf: Your hostname, lidl-pc, resolves to a loopback address; using 172.17.0.1 instead (on interface docker0)
16/04/19 16:10:12 WARN RSCConf: Set 'livy.local.rpc.server.address' if you need to bind to another address.
16/04/19 16:10:13 INFO ContextLauncher: log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell).
16/04/19 16:10:13 INFO ContextLauncher: log4j:WARN Please initialize the log4j system properly.
16/04/19 16:10:13 INFO ContextLauncher: log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
16/04/19 16:10:13 INFO ContextLauncher: Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Requesting a new application from cluster with 1 NodeManagers
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (8192 MB per container)
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Will allocate AM container, with 1408 MB memory including 384 MB overhead
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Setting up container launch context for our AM
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Setting up the launch environment for our AM container
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Preparing resources for our AM container
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/home/lidl/cloud/spark-1.6.1-bin-hadoop2.4/lib/spark-assembly-1.6.1-hadoop2.4.0.jar
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/home/lidl/test/livy/rsc/target/jars/livy-api-0.2.0-SNAPSHOT.jar
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/home/lidl/test/livy/rsc/target/jars/netty-all-4.0.23.Final.jar
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/home/lidl/test/livy/rsc/target/jars/livy-rsc-0.2.0-SNAPSHOT.jar
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/home/lidl/test/livy/repl/target/jars/commons-codec-1.9.jar
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/home/lidl/test/livy/repl/target/jars/livy-repl-0.2.0-SNAPSHOT.jar
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/home/lidl/test/livy/repl/target/jars/livy-core-0.2.0-SNAPSHOT.jar
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Source and destination file systems are the same. Not copying file:/tmp/spark-c2700d18-a459-451b-b443-7b0c14c364b4/__spark_conf__4384991938839680382.zip
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO SecurityManager: Changing view acls to: lidl
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO SecurityManager: Changing modify acls to: lidl
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(lidl); users with modify permissions: Set(lidl)
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Submitting application 4 to ResourceManager
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO YarnClientImpl: Submitted application application_1461052635564_0004
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client: Application report for application_1461052635564_0004 (state: ACCEPTED)
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO Client:
16/04/19 16:10:14 INFO ContextLauncher: client token: N/A
16/04/19 16:10:14 INFO ContextLauncher: diagnostics: N/A
16/04/19 16:10:14 INFO ContextLauncher: ApplicationMaster host: N/A
16/04/19 16:10:14 INFO ContextLauncher: ApplicationMaster RPC port: -1
16/04/19 16:10:14 INFO ContextLauncher: queue: default
16/04/19 16:10:14 INFO ContextLauncher: start time: 1461053414484
16/04/19 16:10:14 INFO ContextLauncher: final status: UNDEFINED
16/04/19 16:10:14 INFO ContextLauncher: tracking URL: http://lidl-pc:8088/proxy/application_1461052635564_0004/
16/04/19 16:10:14 INFO ContextLauncher: user: lidl
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO ShutdownHookManager: Shutdown hook called
16/04/19 16:10:14 INFO ContextLauncher: 16/04/19 16:10:14 INFO ShutdownHookManager: Deleting directory /tmp/spark-c2700d18-a459-451b-b443-7b0c14c364b4

```

 

And ,after minutes idle,server logs show 

 

```

WARNING: Factory com.cloudera.livy.rsc.RSCClientFactory threw an exception.
java.lang.IllegalStateException: Timed out waiting for driver connection information.
at com.cloudera.livy.rsc.Utils.checkState(Utils.java:43)
at com.cloudera.livy.rsc.ContextLauncher.<init>(ContextLauncher.java:102)
at com.cloudera.livy.rsc.RSCClientFactory.createClient(RSCClientFactory.java:62)
at com.cloudera.livy.LivyClientBuilder.build(LivyClientBuilder.java:128)
at com.cloudera.livy.server.interactive.InteractiveSession.<init>(InteractiveSession.scala:123)
at com.cloudera.livy.server.interactive.InteractiveSessionServlet.createSession(InteractiveSessionServlet.scala:48)
at com.cloudera.livy.server.interactive.InteractiveSessionServlet.createSession(InteractiveSessionServlet.scala:37)
at com.cloudera.livy.server.SessionServlet$$anonfun$17$$anon$2$$anonfun$18.apply(SessionServlet.scala:127)
at com.cloudera.livy.server.SessionServlet$$anonfun$17$$anon$2$$anonfun$18.apply(SessionServlet.scala:126)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at scala.concurrent.impl.ExecutionContextImpl$$anon$3.exec(ExecutionContextImpl.scala:107)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

```