Support Questions

MindGlass · ‎07-10-2016

I've installed HDP 2.4.2.0-258 in multi vms on CentOS 6.8.

Zeppelin rpm version : zeppelin_2_4_2_0_258-0.6.0.2.4.2.0-258.el6.noarch.rpm

1st issue.

Not showing Zeppelin Service in +Add Service list.

So I proceeded following this commands.

# VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'` 

# sudo git clone https://github.com/hortonworks-gallery/ambari-zeppelin-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/ZEPPELIN # sudo service ambari-server restart

After restart ambari-server I checked Zeppelin in +Add Service list.

Q. Is that normal process to add Zeppelin service in HDP 2.4.2.0-258 stack version?

2nd issue.

Install completed Zeppelin on some vm managed by hdp 2.4.2.0-258 cluster.

Checked zeppelin server port.

java 18186 zeppelin 821u IPv4 2036527 0t0 TCP *:palace-4 (LISTEN)

Here's zeppelin full logs.

========= zeppelin-setup.log============

spark_version:1.6 detected for spark_home: /usr/hdp/current/spark-client/SETUP_VIEW is trueSetting up zeppelin at /usr/hdp/current/zeppelin-server/libHive metastore detected: hdp03.exem.local. Setting up conf/hive-site.xmlImporting notebooksArchive:  notebooks.zip5a261108ec497defb643a4d37f37f6b511ad85aa  creating: zeppelin-notebooks-master/  creating: zeppelin-notebooks-master/2A94M5J1Z/  inflating: zeppelin-notebooks-master/2A94M5J1Z/note.json  creating: zeppelin-notebooks-master/2ANT56EHN/  inflating: zeppelin-notebooks-master/2ANT56EHN/note.json......  creating: zeppelin-notebooks-master/2BJVW65WS/  inflating: zeppelin-notebooks-master/2BJVW65WS/note.json  creating: zeppelin-notebooks-master/2BNDT63TY/  inflating: zeppelin-notebooks-master/2BNDT63TY/note.json  inflating: zeppelin-notebooks-master/README.md  creating: zeppelin-notebooks-master/screenshots/  inflating: zeppelin-notebooks-master/screenshots/import.png  inflating: zeppelin-notebooks-master/update_all_notebooks.shCompiling Zeppelin view...Skipping setup of Ambari viewSetup completeZeppelin start ^[[60G[^[[0;32m  OK  ^[[0;39m]^MZeppelin stop ^[[60G[^[[0;32m  OK  ^[[0;39m]^MZeppelin start ^[[60G[^[[0;32m  OK  ^[[0;39m]^M

=========================================

============ zeppelin-zeppelin-some_host_fqdn.log=============

 INFO [2016-07-10 14:50:02,149] ({Thread-15} ZeppelinServer.java[run]:124) - Shutting down Zeppelin Server ...  INFO [2016-07-10 14:50:02,169] ({Thread-15} ELContextCleaner.java[contextDestroyed]:63) - javax.el.BeanELResolver purged INFO [2016-07-10 14:50:02,170] ({Thread-15} ContextHandler.java[doStop]:843) - stopped o.e.j.w.WebAppContext{/,file:/usr/hdp/2.4.2.0-258/zeppelin/lib/webapps/webapp/},/usr/hdp/current/zeppelin-server/lib/zeppelin-web-0.6.0.2.4.2.0-258.war INFO [2016-07-10 14:50:02,171] ({Thread-15} ContextHandler.java[doStop]:843) - stopped o.e.j.s.ServletContextHandler{/,null} INFO [2016-07-10 14:50:02,172] ({Thread-15} ContextHandler.java[log]:2040) - Cleaning up Shiro Environment INFO [2016-07-10 14:50:02,172] ({Thread-15} ContextHandler.java[doStop]:843) - stopped o.e.j.s.ServletContextHandler{/,null} INFO [2016-07-10 14:50:02,225] ({Thread-16} InterpreterGroup.java[close]:141) - Close interpreter group 2BP742TZP INFO [2016-07-10 14:50:02,225] ({Thread-18} InterpreterGroup.java[close]:141) - Close interpreter group 2BPFVEA4B....... INFO [2016-07-10 14:50:02,266] ({Thread-50} InterpreterGroup.java[destroy]:205) - Destroy interpreter group 2BSZ9JPS4 INFO [2016-07-10 14:50:02,263] ({Thread-15} NotebookRepoSync.java[close]:349) - Closing all notebook storages INFO [2016-07-10 14:50:02,267] ({Thread-15} ZeppelinServer.java[run]:132) - Bye INFO [2016-07-10 14:50:02,263] ({Thread-49} InterpreterGroup.java[close]:141) - Close interpreter group 2BQQQHYHH INFO [2016-07-10 14:50:05,513] ({main} ZeppelinConfiguration.java[create]:98) - Load configuration from file:/etc/zeppelin/conf.dist/zeppelin-site.xml INFO [2016-07-10 14:50:05,819] ({main} ZeppelinServer.java[setupWebAppContext]:264) - ZeppelinServer Webapp path: /usr/hdp/current/zeppelin-server/lib/webapps INFO [2016-07-10 14:50:05,833] ({main} ZeppelinServer.java[main]:113) - Starting zeppelin server INFO [2016-07-10 14:50:05,835] ({main} Server.java[doStart]:272) - jetty-8.1.14.v20131031 INFO [2016-07-10 14:50:05,864] ({main} ContextHandler.java[log]:2040) - Initializing Shiro environment INFO [2016-07-10 14:50:05,867] ({main} EnvironmentLoader.java[initEnvironment]:128) - Starting Shiro environment initialization. INFO [2016-07-10 14:50:06,058] ({main} EnvironmentLoader.java[initEnvironment]:141) - Shiro environment initialized in 191 ms. INFO [2016-07-10 14:50:06,262] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/cassandra INFO [2016-07-10 14:50:06,282] ({main} CassandraInterpreter.java[<clinit>]:154) - Bootstrapping Cassandra Interpreter INFO [2016-07-10 14:50:06,283] ({main} InterpreterFactory.java[init]:136) - Interpreter cassandra.cassandra found. class=org.apache.zeppelin.cassandra.CassandraInterpreter INFO [2016-07-10 14:50:06,287] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/hbase INFO [2016-07-10 14:50:06,341] ({main} InterpreterFactory.java[init]:136) - Interpreter hbase.hbase found. class=org.apache.zeppelin.hbase.HbaseInterpreter INFO [2016-07-10 14:50:06,343] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/md.............. INFO [2016-07-10 14:50:06,807] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/tajo INFO [2016-07-10 14:50:06,819] ({main} InterpreterFactory.java[init]:136) - Interpreter tajo.tql found. class=org.apache.zeppelin.tajo.TajoInterpreter INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group elasticsearch : id=2BP742TZP, name=elasticsearch INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group angular : id=2BPC96A1E, name=angular INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group alluxio : id=2BPFVEA4B, name=alluxio...... INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group jdbc : id=2BPQW7QZV, name=jdbc INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group flink : id=2BSBT2X2C, name=flink INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group phoenix : id=2BQUJ9GBG, name=phoenix INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group hbase : id=2BQGGGQ1T, name=hbase INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group cassandra : id=2BRAS44PR, name=cassandra INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group hive : id=2BRPDBS2Q, name=hive...... INFO [2016-07-10 14:50:06,855] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group lspark : id=2BRW6NHF9, name=lspark INFO [2016-07-10 14:50:06,871] ({main} VfsLog.java[info]:138) - Using "/tmp/vfs_cache" as temporary files store. INFO [2016-07-10 14:50:07,038] ({main} NotebookAuthorization.java[loadFromFile]:59) - /usr/hdp/current/zeppelin-server/lib/conf/notebook-authorization.json INFO [2016-07-10 14:50:07,069] ({main} StdSchedulerFactory.java[instantiate]:1184) - Using default implementation for ThreadExecutor INFO [2016-07-10 14:50:07,072] ({main} SimpleThreadPool.java[initialize]:268) - Job execution threads will use class loader of thread: main INFO [2016-07-10 14:50:07,086] ({main} SchedulerSignalerImpl.java[<init>]:61) - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl INFO [2016-07-10 14:50:07,086] ({main} QuartzScheduler.java[<init>]:240) - Quartz Scheduler v.2.2.1 created. INFO [2016-07-10 14:50:07,087] ({main} RAMJobStore.java[initialize]:155) - RAMJobStore initialized. INFO [2016-07-10 14:50:07,088] ({main} QuartzScheduler.java[initialize]:305) - Scheduler meta-data: Quartz Scheduler (v2.2.1) 'DefaultQuartzScheduler' with instanceId 'NON_CLUSTERED'  Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.  NOT STARTED.  Currently in standby mode.  Number of jobs executed: 0  Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 10 threads.  Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered. INFO [2016-07-10 14:50:07,088] ({main} StdSchedulerFactory.java[instantiate]:1339) - Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz package: 'quartz.properties' INFO [2016-07-10 14:50:07,088] ({main} StdSchedulerFactory.java[instantiate]:1343) - Quartz scheduler version: 2.2.1 INFO [2016-07-10 14:50:07,088] ({main} QuartzScheduler.java[start]:575) - Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED started.ERROR [2016-07-10 14:50:07,152] ({main} VFSNotebookRepo.java[list]:140) - Can't read note file:///usr/hdp/current/zeppelin-server/lib/notebook/screenshotsjava.io.IOException: file:///usr/hdp/current/zeppelin-server/lib/notebook/screenshots/note.json not foundat org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNote(VFSNotebookRepo.java:154)at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNoteInfo(VFSNotebookRepo.java:180)at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.list(VFSNotebookRepo.java:135)at org.apache.zeppelin.notebook.repo.NotebookRepoSync.list(NotebookRepoSync.java:118)at org.apache.zeppelin.notebook.Notebook.loadAllNotes(Notebook.java:401)at org.apache.zeppelin.notebook.Notebook.<init>(Notebook.java:113)at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:88).......at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791)at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717)at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)at org.eclipse.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.java:229)at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:172)at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)at org.eclipse.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:95)at org.eclipse.jetty.server.Server.doStart(Server.java:282)at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:115) INFO [2016-07-10 14:50:07,645] ({main} Notebook.java[<init>]:116) - Notebook indexing started... INFO [2016-07-10 14:50:08,037] ({main} LuceneSearch.java[addIndexDocs]:285) - Indexing 17 notebooks took 391ms INFO [2016-07-10 14:50:08,037] ({main} Notebook.java[<init>]:118) - Notebook indexing finished: 17 indexed in 0s INFO [2016-07-10 14:50:08,163] ({main} ServerImpl.java[initDestination]:94) - Setting the server's publish address to be / INFO [2016-07-10 14:50:08,265] ({main} StandardDescriptorProcessor.java[visitServlet]:284) - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet INFO [2016-07-10 14:50:08,881] ({main} AbstractConnector.java[doStart]:338) - Started SelectChannelConnector@0.0.0.0:9995 INFO [2016-07-10 14:50:08,881] ({main} ZeppelinServer.java[main]:120) - Done, zeppelin server started=========================================
java.io.IOException: file:///usr/hdp/current/zeppelin-server/lib/notebook/screenshots/note.json not found.

# sh zeppelin-daemon.sh 
statusZeppelin is not running                                    [FAILED]

Searching note.json.

# find . -ls | grep note.json

3546785   96 -rw-r--r--   1 zeppelin hadoop      96143  6월 29 14:35 ./notebook/2B48PF7SN/note.json3546789  268 -rw-r--r--   1 zeppelin hadoop     274336  6월 29 14:35 ./notebook/2B522V3X8/note.json3546783   76 -rw-r--r--   1 zeppelin hadoop      77501  6월 29 14:35 ./notebook/2B21B3AYC/note.json3546773   16 -rw-r--r--   1 zeppelin hadoop      13057  6월 29 14:35 ./notebook/2A94M5J1Z/note.json3546795 1188 -rw-r--r--   1 zeppelin hadoop    1213695  6월 29 14:35 ./notebook/2BBBW75VS/note.json3546793 1048 -rw-r--r--   1 zeppelin hadoop    1071678  6월 29 14:35 ./notebook/2BB5CUPUW/note.json3546803   56 -rw-r--r--   1 zeppelin hadoop      54250  6월 29 14:35 ./notebook/2BJVW65WS/note.json3546781   52 -rw-r--r--   1 zeppelin hadoop      52672  6월 29 14:35 ./notebook/2AS5TY6AQ/note.json3546775   16 -rw-r--r--   1 zeppelin hadoop      14906  6월 29 14:35 ./notebook/2ANT56EHN/note.json3546787   48 -rw-r--r--   1 zeppelin hadoop      46910  6월 29 14:35 ./notebook/2B4TWGC8M/note.json3546779 1292 -rw-r--r--   1 zeppelin hadoop    1319772  6월 29 14:35 ./notebook/2APFTN3NY/note.json3546799  176 -rw-r--r--   1 zeppelin hadoop     178713  6월 29 14:35 ./notebook/2BFAUAD4F/note.json3546777   16 -rw-r--r--   1 zeppelin hadoop      13609  6월 29 14:35 ./notebook/2ANTDG878/note.json3546805   52 -rw-r--r--   1 zeppelin hadoop      51305  6월 29 14:35 ./notebook/2BNDT63TY/note.json3546801   56 -rw-r--r--   1 zeppelin hadoop      56620  6월 29 14:35 ./notebook/2BFGYS3YT/note.json3546797    4 -rw-r--r--   1 zeppelin hadoop       3128  6월 29 14:35 ./notebook/2BEQE47HR/note.json3546791  100 -rw-r--r--   1 zeppelin hadoop     102307  6월 29 14:35 ./notebook/2BAVUZ7NA/note.json

Q. Which of these are proper note.js?

Q. What is that mean with message "NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet"

3rd issue.

if zeppelin.install_python_packages=true

then install failed with following this error.

DEPRECATION: Python 2.6 is no longer supported by the Python core team, please upgrade your Python. A future version of pip will drop support for Python 2.6
Collecting numpy
/usr/lib/python2.6/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.
  SNIMissingWarning
/usr/lib/python2.6/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.

I removed numpy library and upgrade pip version ("pip install --upgrade pip"), then install with command "pip install numpy".

Re-install on the ambari-server UI, i'v got messages Numpy build fails with cannot import multiarray and install failed.

Q. what is compatible version to complete python_packages (python, pip ...)

abajwa · ‎07-10-2016

1. On HDP 2.4.x there are two options to install: one is to use the Ambari service (which is what you are using) and other option is to install manually. See tutorial for full details

2. Only error I can see is that its complaining about the screenshots dir. Can you try removing it (using command below) and restarting Zeppelin via Ambari? Then try to access Zeppelin on port 9995 on whichever node you installed on (e.g. http://<IP_OF_ZEPPELIN_NODE>:9995

rm -rf /usr/hdp/current/zeppelin-server/lib/notebook/screenshots

The note.json files are sample notebooks that are installed to help beginners get started with Zeppelin. You can preview these here: https://github.com/hortonworks-gallery/zeppelin-notebooks

3. For now I would recommend keeping zeppelin.install_python_packages=false. As far as I know this option was only tested on CentOS6 so may not work on other OS's

View solution in original post

abajwa · ‎07-10-2016

1. On HDP 2.4.x there are two options to install: one is to use the Ambari service (which is what you are using) and other option is to install manually. See tutorial for full details

2. Only error I can see is that its complaining about the screenshots dir. Can you try removing it (using command below) and restarting Zeppelin via Ambari? Then try to access Zeppelin on port 9995 on whichever node you installed on (e.g. http://<IP_OF_ZEPPELIN_NODE>:9995

rm -rf /usr/hdp/current/zeppelin-server/lib/notebook/screenshots

The note.json files are sample notebooks that are installed to help beginners get started with Zeppelin. You can preview these here: https://github.com/hortonworks-gallery/zeppelin-notebooks

3. For now I would recommend keeping zeppelin.install_python_packages=false. As far as I know this option was only tested on CentOS6 so may not work on other OS's

MindGlass · ‎07-10-2016

@Ali Bajwa

2. Still not working. And I already reviewed that gallery.

3. I agreed.

Additionally, I tested same hdp version on CentOS 7.2 on Single VM.

VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - $[0-9]\.[0-9]$.*/\1/'`
# sudo git clone https://github.com/hortonworks-gallery/ambari-zeppelin-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/ZEPPELIN # sudo service ambari-server restart

After restart ambari-server

Add Zeppelin notebook

I checked connected Zepplin Web Browser.

http://hdp.single.local:9995/#/

But CentOS 6.8 is not working..

abajwa · ‎07-10-2016

@Peter Kim could you check in the zeppelin logs (under /var/log/zeppelin*) if any other errors appeared this time? In the earlier log it was complaining about the screenshots subdir. If you already removed it and tried restarting Zeppelin and it still did not come up, there probably another problem as well.

There was another recent fix that went in which maybe causing the problem now: https://github.com/hortonworks-gallery/zeppelin-notebooks/pull/19/commits/027f4ad29f71289121949eedd0...

MindGlass · ‎07-10-2016

@Ali Bajwa

Here's full log.

zeppelin.txt

abajwa · ‎07-10-2016

@Peter Kim Based on the log and lsof output, it seems zeppelin server is up and running. If its not opening in the browser, you may need to disable firewalls. Can you ensure you can ping the host running zeppelin from your local host? Also try to telnet into port 9995 from your local host.

MindGlass · ‎07-10-2016

@Ali Bajwa

Already installed latest notebook.

In 2BFAUAD4F

"name":"hdfs-d3",

"id":"2BFAUAD4F",

MindGlass · ‎07-10-2016

@Ali Bajwa

Ping test is OK.

But telnet is connection refused.

telnet hdp06.hadoop.local 9995

telnet: connect to address 115.178.x.x: Connection refused

telnet: Unable to connect to remote host

I think it's weird.

I'm deploying another WAS (tomcat7) on the same node with 8080 port.

This port is access to web browser.

MindGlass · ‎07-10-2016

@Ali Bajwa

I found cause of this issue. hdp06 vm is only opened 8080 port by vpn connection port list.

Thx for your advice.

abajwa · ‎07-10-2016

@Peter Kim great! Please mark the answer as accepted to close the issue...so it doesn't show up on our list of open questions

Cloudera Community

Support Questions

Zeppelin Bug in HDP 2.4.2.0-258