Problem Zeppelin install HDP 2.4

[#1]

Hi, I have followed the steps here:

http://hortonworks.com/hadoop-tutorial/apache-zeppelin-hdp-2-4/ #Installing Zeppelin on an Ambari-Managed Cluster

but the Ambari managed install fails at this script step:

2016-05-10 19:40:39,645 - Execute['/var/lib/ambari-agent/cache/stacks/HDP/2.4/services/ZEPPELIN/package/scripts/setup_snapshot.sh /usr/hdp/current/zeppelin-server/lib master2.r4p2hzj2llcexob4fgsutkohlh.ax.internal.cloudapp.net 9083 10001 master1.r4p2hzj2llcexob4fgsutkohlh.ax.internal.cloudapp.net 9995 True /var/lib/ambari-agent/cache/stacks/HDP/2.4/services/ZEPPELIN/package /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.71-2.b15.el7_2.x86_64 >> /var/log/zeppelin/zeppelin-setup.log'] {'user': 'zeppelin'}
2016-05-10 19:40:41,650 - Execute['cp /usr/hdp/current/zeppelin-server/lib/interpreter/spark/dep/zeppelin-spark-dependencies-*.jar /tmp'] {'user': 'zeppelin'}

====error ==========

 File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'cp /usr/hdp/current/zeppelin-server/lib/interpreter/spark/dep/zeppelin-spark-dependencies-*.jar /tmp' returned 1. cp: cannot stat ?/usr/hdp/current/zeppelin-server/lib/interpreter/spark/dep/zeppelin-spark-dependencies-*.jar?: No such file or directory	

The error is 'right' because the target dir is non-existant: there is only conf/ and notebook/

[xx@master1 ~]$ ls -la /usr/hdp/current/zeppelin-server/lib

total 16

drwxr-xr-x 4 zeppelin zeppelin 4096 May 10 16:19 .

drwxr-xr-x 3 zeppelin hadoop 4096 May 10 15:55 ..

drwxr-xr-x 2 zeppelin hadoop 4096 May 10 16:19 conf

drwxr-xr-x 19 zeppelin hadoop 4096 May 10 19:40 notebook

Anyone a suggestion as to how to fix this?

[#2]

Hello Jasper:

It looks like Zeppelin lib directory is missing lots of things. For instance here is mine under HDP 2.4 Sandbox:

[root@sandbox lib]# cd /usr/hdp/current/zeppelin-server/lib
[root@sandbox lib]# ls -l
total 1384
drwxr-xr-x  2 zeppelin hadoop    4096 2016-03-14 14:34 bin
lrwxrwxrwx  1 zeppelin hadoop      18 2016-03-14 14:34 conf -> /etc/zeppelin/conf
drwxr-xr-x 17 zeppelin hadoop    4096 2016-03-14 14:35 interpreter
drwxr-xr-x  2 zeppelin hadoop    4096 2016-03-14 14:35 lib
-rw-r--r--  1 zeppelin hadoop   13540 2016-02-10 10:40 LICENSE
drwxr-xr-x  5 zeppelin hadoop    4096 2016-05-04 23:36 local-repo
drwxr-xr-x 21 zeppelin hadoop    4096 2016-04-19 13:36 notebook
-rw-r--r--  1 zeppelin hadoop    6675 2016-02-10 10:40 README.md
drwxr-xr-x  3 zeppelin hadoop    4096 2016-04-14 16:30 webapps
-rw-r--r--  1 zeppelin hadoop   66393 2016-02-10 10:48 zeppelin-server-0.6.0.2.4.0.0-169.jar
-rw-r--r--  1 zeppelin hadoop 1297455 2016-02-10 10:48 zeppelin-web-0.6.0.2.4.0.0-169.war

Did you already perform the Add Service step:

After Ambari restarts and service indicators turn green, add the Zeppelin Service: At the bottom left of the Ambari dashboard, choose Actions -> Add Service:

On the Add Service screen, select the Zeppelin service. Step through the rest of the installation process, accepting all default values. On the Review screen, make a note of the node selected to run Zeppelin service; call this ZEPPELIN_HOST.

Click Deploy to complete the installation process.

[#3 · Accepted solution]

You are right Paul, it is missing a lot.

Found the problem in the meantime. On a fresh HDP 2.4 Zeppelin is not installed but there are some things prepared already like a symlink in /usr/hdp/current/zeppelin-server -> /usr/hdp/2.4.0.0-169/zeppelin/ (pointing to a non-existant folder)

When you follow the steps the Python scripts at some point do a 'yum install zeppelin' but in the meantime with things progressing it wil install version 2.4.2.0-258 WITHOUT updating the symlink properly. Besides that the scripted install is fine.

Tried to make the script install version 2.4.0.0-169 of Zeppelin but didn't succeed, so in the end al it took was updating the symlink:

ln -f -s /usr/hdp/2.4.2.0-258/zeppelin/ /usr/hdp/current/zeppelin-server

If you then rerun all from Ambari it should be fine and you'll have the newest Zeppelin installed.