I've installed HDP 2.4.2.0-258 in multi vms on CentOS 6.8.
Zeppelin rpm version : zeppelin_2_4_2_0_258-0.6.0.2.4.2.0-258.el6.noarch.rpm
1st issue.
Not showing Zeppelin Service in +Add Service list.
So I proceeded following this commands.
# VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'`
# sudo git clone https://github.com/hortonworks-gallery/ambari-zeppelin-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/ZEPPELIN # sudo service ambari-server restart
After restart ambari-server I checked Zeppelin in +Add Service list.
Q. Is that normal process to add Zeppelin service in HDP 2.4.2.0-258 stack version?
2nd issue.
Install completed Zeppelin on some vm managed by hdp 2.4.2.0-258 cluster.
Checked zeppelin server port.
java 18186 zeppelin 821u IPv4 2036527 0t0 TCP *:palace-4 (LISTEN)
Here's zeppelin full logs.
========= zeppelin-setup.log============
spark_version:1.6 detected for spark_home: /usr/hdp/current/spark-client/SETUP_VIEW is trueSetting up zeppelin at /usr/hdp/current/zeppelin-server/libHive metastore detected: hdp03.exem.local. Setting up conf/hive-site.xmlImporting notebooksArchive: notebooks.zip5a261108ec497defb643a4d37f37f6b511ad85aa creating: zeppelin-notebooks-master/ creating: zeppelin-notebooks-master/2A94M5J1Z/ inflating: zeppelin-notebooks-master/2A94M5J1Z/note.json creating: zeppelin-notebooks-master/2ANT56EHN/ inflating: zeppelin-notebooks-master/2ANT56EHN/note.json...... creating: zeppelin-notebooks-master/2BJVW65WS/ inflating: zeppelin-notebooks-master/2BJVW65WS/note.json creating: zeppelin-notebooks-master/2BNDT63TY/ inflating: zeppelin-notebooks-master/2BNDT63TY/note.json inflating: zeppelin-notebooks-master/README.md creating: zeppelin-notebooks-master/screenshots/ inflating: zeppelin-notebooks-master/screenshots/import.png inflating: zeppelin-notebooks-master/update_all_notebooks.shCompiling Zeppelin view...Skipping setup of Ambari viewSetup completeZeppelin start ^[[60G[^[[0;32m OK ^[[0;39m]^MZeppelin stop ^[[60G[^[[0;32m OK ^[[0;39m]^MZeppelin start ^[[60G[^[[0;32m OK ^[[0;39m]^M
=========================================
============ zeppelin-zeppelin-some_host_fqdn.log=============
INFO [2016-07-10 14:50:02,149] ({Thread-15} ZeppelinServer.java[run]:124) - Shutting down Zeppelin Server ... INFO [2016-07-10 14:50:02,169] ({Thread-15} ELContextCleaner.java[contextDestroyed]:63) - javax.el.BeanELResolver purged INFO [2016-07-10 14:50:02,170] ({Thread-15} ContextHandler.java[doStop]:843) - stopped o.e.j.w.WebAppContext{/,file:/usr/hdp/2.4.2.0-258/zeppelin/lib/webapps/webapp/},/usr/hdp/current/zeppelin-server/lib/zeppelin-web-0.6.0.2.4.2.0-258.war INFO [2016-07-10 14:50:02,171] ({Thread-15} ContextHandler.java[doStop]:843) - stopped o.e.j.s.ServletContextHandler{/,null} INFO [2016-07-10 14:50:02,172] ({Thread-15} ContextHandler.java[log]:2040) - Cleaning up Shiro Environment INFO [2016-07-10 14:50:02,172] ({Thread-15} ContextHandler.java[doStop]:843) - stopped o.e.j.s.ServletContextHandler{/,null} INFO [2016-07-10 14:50:02,225] ({Thread-16} InterpreterGroup.java[close]:141) - Close interpreter group 2BP742TZP INFO [2016-07-10 14:50:02,225] ({Thread-18} InterpreterGroup.java[close]:141) - Close interpreter group 2BPFVEA4B....... INFO [2016-07-10 14:50:02,266] ({Thread-50} InterpreterGroup.java[destroy]:205) - Destroy interpreter group 2BSZ9JPS4 INFO [2016-07-10 14:50:02,263] ({Thread-15} NotebookRepoSync.java[close]:349) - Closing all notebook storages INFO [2016-07-10 14:50:02,267] ({Thread-15} ZeppelinServer.java[run]:132) - Bye INFO [2016-07-10 14:50:02,263] ({Thread-49} InterpreterGroup.java[close]:141) - Close interpreter group 2BQQQHYHH INFO [2016-07-10 14:50:05,513] ({main} ZeppelinConfiguration.java[create]:98) - Load configuration from file:/etc/zeppelin/conf.dist/zeppelin-site.xml INFO [2016-07-10 14:50:05,819] ({main} ZeppelinServer.java[setupWebAppContext]:264) - ZeppelinServer Webapp path: /usr/hdp/current/zeppelin-server/lib/webapps INFO [2016-07-10 14:50:05,833] ({main} ZeppelinServer.java[main]:113) - Starting zeppelin server INFO [2016-07-10 14:50:05,835] ({main} Server.java[doStart]:272) - jetty-8.1.14.v20131031 INFO [2016-07-10 14:50:05,864] ({main} ContextHandler.java[log]:2040) - Initializing Shiro environment INFO [2016-07-10 14:50:05,867] ({main} EnvironmentLoader.java[initEnvironment]:128) - Starting Shiro environment initialization. INFO [2016-07-10 14:50:06,058] ({main} EnvironmentLoader.java[initEnvironment]:141) - Shiro environment initialized in 191 ms. INFO [2016-07-10 14:50:06,262] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/cassandra INFO [2016-07-10 14:50:06,282] ({main} CassandraInterpreter.java[<clinit>]:154) - Bootstrapping Cassandra Interpreter INFO [2016-07-10 14:50:06,283] ({main} InterpreterFactory.java[init]:136) - Interpreter cassandra.cassandra found. class=org.apache.zeppelin.cassandra.CassandraInterpreter INFO [2016-07-10 14:50:06,287] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/hbase INFO [2016-07-10 14:50:06,341] ({main} InterpreterFactory.java[init]:136) - Interpreter hbase.hbase found. class=org.apache.zeppelin.hbase.HbaseInterpreter INFO [2016-07-10 14:50:06,343] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/md.............. INFO [2016-07-10 14:50:06,807] ({main} InterpreterFactory.java[init]:119) - Reading /usr/hdp/current/zeppelin-server/lib/interpreter/tajo INFO [2016-07-10 14:50:06,819] ({main} InterpreterFactory.java[init]:136) - Interpreter tajo.tql found. class=org.apache.zeppelin.tajo.TajoInterpreter INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group elasticsearch : id=2BP742TZP, name=elasticsearch INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group angular : id=2BPC96A1E, name=angular INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group alluxio : id=2BPFVEA4B, name=alluxio...... INFO [2016-07-10 14:50:06,853] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group jdbc : id=2BPQW7QZV, name=jdbc INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group flink : id=2BSBT2X2C, name=flink INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group phoenix : id=2BQUJ9GBG, name=phoenix INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group hbase : id=2BQGGGQ1T, name=hbase INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group cassandra : id=2BRAS44PR, name=cassandra INFO [2016-07-10 14:50:06,854] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group hive : id=2BRPDBS2Q, name=hive...... INFO [2016-07-10 14:50:06,855] ({main} InterpreterFactory.java[init]:198) - Interpreter setting group lspark : id=2BRW6NHF9, name=lspark INFO [2016-07-10 14:50:06,871] ({main} VfsLog.java[info]:138) - Using "/tmp/vfs_cache" as temporary files store. INFO [2016-07-10 14:50:07,038] ({main} NotebookAuthorization.java[loadFromFile]:59) - /usr/hdp/current/zeppelin-server/lib/conf/notebook-authorization.json INFO [2016-07-10 14:50:07,069] ({main} StdSchedulerFactory.java[instantiate]:1184) - Using default implementation for ThreadExecutor INFO [2016-07-10 14:50:07,072] ({main} SimpleThreadPool.java[initialize]:268) - Job execution threads will use class loader of thread: main INFO [2016-07-10 14:50:07,086] ({main} SchedulerSignalerImpl.java[<init>]:61) - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl INFO [2016-07-10 14:50:07,086] ({main} QuartzScheduler.java[<init>]:240) - Quartz Scheduler v.2.2.1 created. INFO [2016-07-10 14:50:07,087] ({main} RAMJobStore.java[initialize]:155) - RAMJobStore initialized. INFO [2016-07-10 14:50:07,088] ({main} QuartzScheduler.java[initialize]:305) - Scheduler meta-data: Quartz Scheduler (v2.2.1) 'DefaultQuartzScheduler' with instanceId 'NON_CLUSTERED' Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally. NOT STARTED. Currently in standby mode. Number of jobs executed: 0 Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 10 threads. Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered. INFO [2016-07-10 14:50:07,088] ({main} StdSchedulerFactory.java[instantiate]:1339) - Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz package: 'quartz.properties' INFO [2016-07-10 14:50:07,088] ({main} StdSchedulerFactory.java[instantiate]:1343) - Quartz scheduler version: 2.2.1 INFO [2016-07-10 14:50:07,088] ({main} QuartzScheduler.java[start]:575) - Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED started.ERROR [2016-07-10 14:50:07,152] ({main} VFSNotebookRepo.java[list]:140) - Can't read note file:///usr/hdp/current/zeppelin-server/lib/notebook/screenshotsjava.io.IOException: file:///usr/hdp/current/zeppelin-server/lib/notebook/screenshots/note.json not foundat org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNote(VFSNotebookRepo.java:154)at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.getNoteInfo(VFSNotebookRepo.java:180)at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.list(VFSNotebookRepo.java:135)at org.apache.zeppelin.notebook.repo.NotebookRepoSync.list(NotebookRepoSync.java:118)at org.apache.zeppelin.notebook.Notebook.loadAllNotes(Notebook.java:401)at org.apache.zeppelin.notebook.Notebook.<init>(Notebook.java:113)at org.apache.zeppelin.server.ZeppelinServer.<init>(ZeppelinServer.java:88).......at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791)at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717)at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)at org.eclipse.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.java:229)at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:172)at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)at org.eclipse.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:95)at org.eclipse.jetty.server.Server.doStart(Server.java:282)at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:115) INFO [2016-07-10 14:50:07,645] ({main} Notebook.java[<init>]:116) - Notebook indexing started... INFO [2016-07-10 14:50:08,037] ({main} LuceneSearch.java[addIndexDocs]:285) - Indexing 17 notebooks took 391ms INFO [2016-07-10 14:50:08,037] ({main} Notebook.java[<init>]:118) - Notebook indexing finished: 17 indexed in 0s INFO [2016-07-10 14:50:08,163] ({main} ServerImpl.java[initDestination]:94) - Setting the server's publish address to be / INFO [2016-07-10 14:50:08,265] ({main} StandardDescriptorProcessor.java[visitServlet]:284) - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet INFO [2016-07-10 14:50:08,881] ({main} AbstractConnector.java[doStart]:338) - Started SelectChannelConnector@0.0.0.0:9995 INFO [2016-07-10 14:50:08,881] ({main} ZeppelinServer.java[main]:120) - Done, zeppelin server started=========================================
java.io.IOException: file:///usr/hdp/current/zeppelin-server/lib/notebook/screenshots/note.json not found.
# sh zeppelin-daemon.sh
statusZeppelin is not running [FAILED]
Searching note.json.
# find . -ls | grep note.json
3546785 96 -rw-r--r-- 1 zeppelin hadoop 96143 6월 29 14:35 ./notebook/2B48PF7SN/note.json3546789 268 -rw-r--r-- 1 zeppelin hadoop 274336 6월 29 14:35 ./notebook/2B522V3X8/note.json3546783 76 -rw-r--r-- 1 zeppelin hadoop 77501 6월 29 14:35 ./notebook/2B21B3AYC/note.json3546773 16 -rw-r--r-- 1 zeppelin hadoop 13057 6월 29 14:35 ./notebook/2A94M5J1Z/note.json3546795 1188 -rw-r--r-- 1 zeppelin hadoop 1213695 6월 29 14:35 ./notebook/2BBBW75VS/note.json3546793 1048 -rw-r--r-- 1 zeppelin hadoop 1071678 6월 29 14:35 ./notebook/2BB5CUPUW/note.json3546803 56 -rw-r--r-- 1 zeppelin hadoop 54250 6월 29 14:35 ./notebook/2BJVW65WS/note.json3546781 52 -rw-r--r-- 1 zeppelin hadoop 52672 6월 29 14:35 ./notebook/2AS5TY6AQ/note.json3546775 16 -rw-r--r-- 1 zeppelin hadoop 14906 6월 29 14:35 ./notebook/2ANT56EHN/note.json3546787 48 -rw-r--r-- 1 zeppelin hadoop 46910 6월 29 14:35 ./notebook/2B4TWGC8M/note.json3546779 1292 -rw-r--r-- 1 zeppelin hadoop 1319772 6월 29 14:35 ./notebook/2APFTN3NY/note.json3546799 176 -rw-r--r-- 1 zeppelin hadoop 178713 6월 29 14:35 ./notebook/2BFAUAD4F/note.json3546777 16 -rw-r--r-- 1 zeppelin hadoop 13609 6월 29 14:35 ./notebook/2ANTDG878/note.json3546805 52 -rw-r--r-- 1 zeppelin hadoop 51305 6월 29 14:35 ./notebook/2BNDT63TY/note.json3546801 56 -rw-r--r-- 1 zeppelin hadoop 56620 6월 29 14:35 ./notebook/2BFGYS3YT/note.json3546797 4 -rw-r--r-- 1 zeppelin hadoop 3128 6월 29 14:35 ./notebook/2BEQE47HR/note.json3546791 100 -rw-r--r-- 1 zeppelin hadoop 102307 6월 29 14:35 ./notebook/2BAVUZ7NA/note.json
Q. Which of these are proper note.js?
Q. What is that mean with message "NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet"
3rd issue.
if zeppelin.install_python_packages=true
then install failed with following this error.
DEPRECATION: Python 2.6 is no longer supported by the Python core team, please upgrade your Python. A future version of pip will drop support for Python 2.6
Collecting numpy
/usr/lib/python2.6/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.
SNIMissingWarning
/usr/lib/python2.6/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
I removed numpy library and upgrade pip version ("pip install --upgrade pip"), then install with command "pip install numpy".
Re-install on the ambari-server UI, i'v got messages Numpy build fails with cannot import multiarray and install failed.
Q. what is compatible version to complete python_packages (python, pip ...)
