Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Zeppelin - Hive interpreter not found

avatar
Expert Contributor

My HDP-2.5 cluster has Zeppelin 0.6 from the box. It works fine. But when I install additional Zeppelin 0.7.0-SNAPSHOT (on the same datanode with Zeppelin 0.6) I get error "Interpreter hive not found". It's not tutorial code, I create new notebook and try run my own query.

I follow this instruction https://zeppelin.apache.org/docs/0.5.5-incubating/install/yarn_install.html. Using this instruction I successfully installed Zeppelin 0.7.0 on HDP-2.4 cluster.

Hadoop version 2.5.0.0-1245
Dependencies in JDBC interpreter:
org.apache.hive:hive-jdbc:2.0.1
org.apache.hadoop:hadoop-common:2.7.2
File hive-site.xml is copied from /etc/hive/conf/hive-site.xml to /home/zeppelin_price/incubator-zeppelin/conf

zeppelin-env.sh

export ZEPPELIN_PORT=8096
export JAVA_HOME=/usr/jdk64/jdk1.7.0_79
export ZEPPELIN_JAVA_OPTS="-Dhdp.version=2.5.0.0-1245"
export HADOOP_CONF_DIR=/etc/hadoop/conf 
other variables are commented

Log zeppelin-zeppelin_price-hdp-dn2.co.vectis.local.out

ZEPPELIN_CLASSPATH: ::/home/zeppelin_price/incubator-zeppelin/zeppelin-server/target/lib/*:/home/zeppelin_price/incubator-zeppelin/zeppelin-zengine/target/lib/*:/home/zeppelin_price/incubator-zeppelin/zeppelin-interpreter/target/lib/*:/home/zeppelin_price/incubator-zeppelin/*::/home/zeppelin_price/incubator-zeppelin/conf:/home/zeppelin_price/incubator-zeppelin/zeppelin-interpreter/target/classes:/home/zeppelin_price/incubator-zeppelin/zeppelin-zengine/target/classes:/home/zeppelin_price/incubator-zeppelin/zeppelin-server/target/classes
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/zeppelin_price/incubator-zeppelin/zeppelin-server/target/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/zeppelin_price/incubator-zeppelin/zeppelin-server/target/lib/zeppelin-interpreter-0.7.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/zeppelin_price/incubator-zeppelin/zeppelin-zengine/target/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/zeppelin_price/incubator-zeppelin/zeppelin-zengine/target/lib/zeppelin-interpreter-0.7.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/zeppelin_price/incubator-zeppelin/zeppelin-interpreter/target/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Sep 26, 2016 1:19:29 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
  org.apache.zeppelin.rest
Sep 26, 2016 1:19:29 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
  class org.apache.zeppelin.rest.ZeppelinRestApi
  class org.apache.zeppelin.rest.ConfigurationsRestApi
  class org.apache.zeppelin.rest.InterpreterRestApi
  class org.apache.zeppelin.rest.NotebookRestApi
  class org.apache.zeppelin.rest.CredentialRestApi
  class org.apache.zeppelin.rest.LoginRestApi
  class org.apache.zeppelin.rest.SecurityRestApi
  class org.apache.zeppelin.rest.HeliumRestApi
Sep 26, 2016 1:19:29 PM com.sun.jersey.api.core.ScanningResourceConfig init
INFO: No provider classes found.
Sep 26, 2016 1:19:29 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.13 06/29/2012 05:14 PM'
Sep 26, 2016 1:19:30 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
  WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.CredentialRestApi.getCredentials(java.lang.String) throws java.io.IOException,java.lang.IllegalArgumentException, should not consume any entity.
  WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.createNote(java.lang.String) throws java.io.IOException, with URI template, "/", is treated as a resource method
  WARNING: A sub-resource method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.NotebookRestApi.getNotebookList() throws java.io.IOException, with URI template, "/", is treated as a resource method
  WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.apache.zeppelin.rest.InterpreterRestApi.listInterpreter(java.lang.String), should not consume any entity.

Log zeppelin-zeppelin_price-hdp-dn2.co.vectis.local.log

ERROR [2016-09-26 13:21:27,987] ({qtp396501207-56} NotebookServer.java[runParagraph]:1154) - Exception from run
org.apache.zeppelin.interpreter.InterpreterException: paragraph_1474884934206_-1103344564's Interpreter hive not found
	at org.apache.zeppelin.notebook.Note.run(Note.java:489)
	at org.apache.zeppelin.socket.NotebookServer.runParagraph(NotebookServer.java:1152)
	at org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:195)
	at org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:56)
	at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
	at org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69)
	at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65)
	at org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
	at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161)
	at org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309)
	at org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214)
	at org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220)
	at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258)
	at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632)
	at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480)
	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
	at java.lang.Thread.run(Thread.java:745)
1 ACCEPTED SOLUTION

avatar
Expert Contributor

Finally I solved this problem by copying folder ZEPPELIN_HOME/incubator-zeppelin from dev cluster (that I installed one month ago) to production cluster. Now it works fine.

View solution in original post

3 REPLIES 3

avatar
Super Collaborator

@Alena Melnikova If you are using zeppelin service as part of HDP 2.5. Have you followed https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/upgrade.html

(Also Some expert can comment if this is official way of upgrading zeppelin service on HDP)

avatar
Expert Contributor

@pankaj singh thanks for the help.

According to https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/upgrade.html:

  • I stopped Zeppelin 0.6 from Ambari, stopped Zeppelin 0.7
  • Copied conf folder from /etc/zeppelin/2.5.0.0-1245/0 to /home/zeppelin_price/incubator-zeppelin/conf
  • Run Zeppelin 0.7

Nothing change. Still "Interpreter hive not found", logs the same as I posted before.

avatar
Expert Contributor

Finally I solved this problem by copying folder ZEPPELIN_HOME/incubator-zeppelin from dev cluster (that I installed one month ago) to production cluster. Now it works fine.