Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Problem Zeppelin install HDP 2.4

Solved Go to solution

Problem Zeppelin install HDP 2.4

New Contributor

Hi, I have followed the steps here:

http://hortonworks.com/hadoop-tutorial/apache-zeppelin-hdp-2-4/ #Installing Zeppelin on an Ambari-Managed Cluster

but the Ambari managed install fails at this script step:

2016-05-10 19:40:39,645 - Execute['/var/lib/ambari-agent/cache/stacks/HDP/2.4/services/ZEPPELIN/package/scripts/setup_snapshot.sh /usr/hdp/current/zeppelin-server/lib master2.r4p2hzj2llcexob4fgsutkohlh.ax.internal.cloudapp.net 9083 10001 master1.r4p2hzj2llcexob4fgsutkohlh.ax.internal.cloudapp.net 9995 True /var/lib/ambari-agent/cache/stacks/HDP/2.4/services/ZEPPELIN/package /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.71-2.b15.el7_2.x86_64 >> /var/log/zeppelin/zeppelin-setup.log'] {'user': 'zeppelin'}
2016-05-10 19:40:41,650 - Execute['cp /usr/hdp/current/zeppelin-server/lib/interpreter/spark/dep/zeppelin-spark-dependencies-*.jar /tmp'] {'user': 'zeppelin'}

====error ==========

 File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'cp /usr/hdp/current/zeppelin-server/lib/interpreter/spark/dep/zeppelin-spark-dependencies-*.jar /tmp' returned 1. cp: cannot stat ?/usr/hdp/current/zeppelin-server/lib/interpreter/spark/dep/zeppelin-spark-dependencies-*.jar?: No such file or directory	

The error is 'right' because the target dir is non-existant: there is only conf/ and notebook/

[xx@master1 ~]$ ls -la /usr/hdp/current/zeppelin-server/lib

total 16

drwxr-xr-x 4 zeppelin zeppelin 4096 May 10 16:19 .

drwxr-xr-x 3 zeppelin hadoop 4096 May 10 15:55 ..

drwxr-xr-x 2 zeppelin hadoop 4096 May 10 16:19 conf

drwxr-xr-x 19 zeppelin hadoop 4096 May 10 19:40 notebook

Anyone a suggestion as to how to fix this?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Problem Zeppelin install HDP 2.4

New Contributor

You are right Paul, it is missing a lot.

Found the problem in the meantime. On a fresh HDP 2.4 Zeppelin is not installed but there are some things prepared already like a symlink in /usr/hdp/current/zeppelin-server -> /usr/hdp/2.4.0.0-169/zeppelin/ (pointing to a non-existant folder)

When you follow the steps the Python scripts at some point do a 'yum install zeppelin' but in the meantime with things progressing it wil install version 2.4.2.0-258 WITHOUT updating the symlink properly. Besides that the scripted install is fine.

Tried to make the script install version 2.4.0.0-169 of Zeppelin but didn't succeed, so in the end al it took was updating the symlink:

ln -f -s /usr/hdp/2.4.2.0-258/zeppelin/ /usr/hdp/current/zeppelin-server

If you then rerun all from Ambari it should be fine and you'll have the newest Zeppelin installed.

2 REPLIES 2

Re: Problem Zeppelin install HDP 2.4

Hello Jasper:

It looks like Zeppelin lib directory is missing lots of things. For instance here is mine under HDP 2.4 Sandbox:

[root@sandbox lib]# cd /usr/hdp/current/zeppelin-server/lib
[root@sandbox lib]# ls -l
total 1384
drwxr-xr-x  2 zeppelin hadoop    4096 2016-03-14 14:34 bin
lrwxrwxrwx  1 zeppelin hadoop      18 2016-03-14 14:34 conf -> /etc/zeppelin/conf
drwxr-xr-x 17 zeppelin hadoop    4096 2016-03-14 14:35 interpreter
drwxr-xr-x  2 zeppelin hadoop    4096 2016-03-14 14:35 lib
-rw-r--r--  1 zeppelin hadoop   13540 2016-02-10 10:40 LICENSE
drwxr-xr-x  5 zeppelin hadoop    4096 2016-05-04 23:36 local-repo
drwxr-xr-x 21 zeppelin hadoop    4096 2016-04-19 13:36 notebook
-rw-r--r--  1 zeppelin hadoop    6675 2016-02-10 10:40 README.md
drwxr-xr-x  3 zeppelin hadoop    4096 2016-04-14 16:30 webapps
-rw-r--r--  1 zeppelin hadoop   66393 2016-02-10 10:48 zeppelin-server-0.6.0.2.4.0.0-169.jar
-rw-r--r--  1 zeppelin hadoop 1297455 2016-02-10 10:48 zeppelin-web-0.6.0.2.4.0.0-169.war

Did you already perform the Add Service step:

After Ambari restarts and service indicators turn green, add the Zeppelin Service: At the bottom left of the Ambari dashboard, choose Actions -> Add Service:

On the Add Service screen, select the Zeppelin service. Step through the rest of the installation process, accepting all default values. On the Review screen, make a note of the node selected to run Zeppelin service; call this ZEPPELIN_HOST.

Click Deploy to complete the installation process.

Re: Problem Zeppelin install HDP 2.4

New Contributor

You are right Paul, it is missing a lot.

Found the problem in the meantime. On a fresh HDP 2.4 Zeppelin is not installed but there are some things prepared already like a symlink in /usr/hdp/current/zeppelin-server -> /usr/hdp/2.4.0.0-169/zeppelin/ (pointing to a non-existant folder)

When you follow the steps the Python scripts at some point do a 'yum install zeppelin' but in the meantime with things progressing it wil install version 2.4.2.0-258 WITHOUT updating the symlink properly. Besides that the scripted install is fine.

Tried to make the script install version 2.4.0.0-169 of Zeppelin but didn't succeed, so in the end al it took was updating the symlink:

ln -f -s /usr/hdp/2.4.2.0-258/zeppelin/ /usr/hdp/current/zeppelin-server

If you then rerun all from Ambari it should be fine and you'll have the newest Zeppelin installed.