question Re: Zeppelin notebook exception - HDFS permissions? in Archives of Support Questions (Read Only)

Zeppelin notebook exception - HDFS permissions?

zack_riesland — Tue, 24 May 2016 20:25:20 GMT

We installed Zeppelin along with our upgrade to 2.4.2

In Ambari, everything looks good, but when I try to actually interact with it, nothing seems to happen.

When I look at the log file on the server, it shows the error below. Could this just be a permissions issue?

INFO [2016-05-24 09:15:00,707] ({qtp895821303-5595} NotebookServer.java[onClose]:213) - Closed connection to 10.1.165.24 : 63750. (1001) null 
WARN [2016-05-24 09:15:01,104] ({qtp895821303-5592} SecurityRestApi.java[ticket]:79) - {"status":"OK","message":"","body":{"principal":"anonymous","ticket":"anonymous","roles":"[]"}} 
INFO [2016-05-24 09:15:01,154] ({qtp895821303-5592} NotebookServer.java[onOpen]:92) - New connection from 10.1.165.24 : 63761 
ERROR [2016-05-24 09:15:13,897] ({qtp895821303-5593} NotebookServer.java[onMessage]:207) - Can't handle message 
org.apache.commons.vfs2.FileSystemException: Could not create folder "file:///usr/hdp/current/zeppelin-server/lib/notebook/2BNKRY7B6". 
at org.apache.commons.vfs2.provider.AbstractFileObject.createFolder(AbstractFileObject.java:999) 
at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.save(VFSNotebookRepo.java:218) 
at org.apache.zeppelin.notebook.repo.NotebookRepoSync.save(NotebookRepoSync.java:144) 
at org.apache.zeppelin.notebook.Note.persist(Note.java:439) 
at org.apache.zeppelin.notebook.Notebook.createNote(Notebook.java:159) 
at org.apache.zeppelin.notebook.Notebook.createNote(Notebook.java:133) 
at org.apache.zeppelin.socket.NotebookServer.createNote(NotebookServer.java:497) 
at org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:147) 
at org.apache.zeppelin.socket.NotebookSocket.onMessage(NotebookSocket.java:56) 
at org.eclipse.jetty.websocket.WebSocketConnectionRFC6455$WSFrameHandler.onFrame(WebSocketConnectionRFC6455.java:835) 
at org.eclipse.jetty.websocket.WebSocketParserRFC6455.parseNext(WebSocketParserRFC6455.java:349) 
at org.eclipse.jetty.websocket.WebSocketConnectionRFC6455.handle(WebSocketConnectionRFC6455.java:225) 
at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:667) 
at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) 
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) 
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
at java.lang.Thread.run(Thread.java:745) 
Caused by: org.apache.commons.vfs2.FileSystemException: Could not create directory "/usr/hdp/current/zeppelin-server/lib/notebook/2BNKRY7B6". 
at org.apache.commons.vfs2.provider.local.LocalFile.doCreateFolder(LocalFile.java:153) 
at org.apache.commons.vfs2.provider.AbstractFileObject.createFolder(AbstractFileObject.java:988)

Re: Zeppelin notebook exception - HDFS permissions?

yjagadeesan — Tue, 24 May 2016 20:39:17 GMT

@Zack Riesland This does not look like the HDFS permission issue. Zeppelin is not able to create its notebook on the OS in the location /usr/hdp/current/zeppelin-server/lib/notebook/2BNKRY7B6

Check the permissions/directories in the location /usr/hdp/current/zeppelin-server

Re: Zeppelin notebook exception - HDFS permissions?

zack_riesland — Tue, 24 May 2016 20:39:40 GMT

What should the permissions be?

[root@myserver log]# ls -alh /usr/hdp/current/zeppelin-server/lib total 1.4M drwxrwxrwx. 7 root root 4.0K May 20 12:25 . drwxr-xr-x. 3 root root 4.0K May 19 17:41 .. drwxr-xr-x. 2 root root 4.0K May 19 17:41 bin lrwxrwxrwx. 1 root root 18 May 19 17:41 conf -> /etc/zeppelin/conf drwxr-xr-x. 21 root root 4.0K May 19 17:42 interpreter drwxr-xr-x. 2 root root 4.0K May 19 17:42 lib -rw-r--r--. 1 root root 14K Apr 20 02:27 LICENSE drwxr-xr-x. 2 root root 4.0K May 20 12:25 notebook -rwxrwxrwx. 1 root root 6.7K Apr 20 02:27 README.md drwxrwxrwx. 3 root root 4.0K May 19 17:58 webapps -rwxrwxrwx. 1 root root 76K Apr 25 06:22 zeppelin-server-0.6.0.2.4.2.0-258.jar -rwxrwxrwx. 1 root root 1.3M Apr 25 06:22 zeppelin-web-0.6.0.2.4.2.0-258.war [root@myserver log]# ls -alh /usr/hdp/current/zeppelin-server/lib/notebook/ total 8.0K drwxr-xr-x. 2 root root 4.0K May 20 12:25 . drwxrwxrwx. 7 root root 4.0K May 20 12:25 .. [root@myserver log]#

Re: Zeppelin notebook exception - HDFS permissions?

zack_riesland — Tue, 24 May 2016 20:40:16 GMT

(sorry for the ugly formatting - it looks fine when I submit it)

Re: Zeppelin notebook exception - HDFS permissions?

yjagadeesan — Tue, 24 May 2016 20:55:44 GMT

Below is the permission what I have and it works fine. Just tested it.

[root@sandbox current]# cd zeppelin-server/
[root@sandbox zeppelin-server]# ls -la
total 12
drwxr-xr-x  3 zeppelin hadoop   4096 2016-03-14 14:34 .
drwxr-xr-x 40 root     root     4096 2016-03-14 15:04 ..
drwxr-xr-x  7 zeppelin zeppelin 4096 2016-04-13 15:39 lib
[root@sandbox zeppelin-server]# cd lib
[root@sandbox lib]# ls -ltr
total 1380
-rw-r--r--  1 zeppelin hadoop    6675 2016-02-10 10:40 README.md
-rw-r--r--  1 zeppelin hadoop   13540 2016-02-10 10:40 LICENSE
-rw-r--r--  1 zeppelin hadoop 1297455 2016-02-10 10:48 zeppelin-web-0.6.0.2.4.0.0-169.war
-rw-r--r--  1 zeppelin hadoop   66393 2016-02-10 10:48 zeppelin-server-0.6.0.2.4.0.0-169.jar
lrwxrwxrwx  1 zeppelin hadoop      18 2016-03-14 14:34 conf -> /etc/zeppelin/conf
drwxr-xr-x  2 zeppelin hadoop    4096 2016-03-14 14:34 bin
drwxr-xr-x 17 zeppelin hadoop    4096 2016-03-14 14:35 interpreter
drwxr-xr-x  2 zeppelin hadoop    4096 2016-03-14 14:35 lib
drwxr-xr-x  3 zeppelin hadoop    4096 2016-04-13 15:39 webapps
drwxr-xr-x 17 zeppelin hadoop    4096 2016-05-24 13:52 notebook

Let me know after you set it and still has a problem.

Re: Zeppelin notebook exception - HDFS permissions?

zack_riesland — Tue, 24 May 2016 21:08:17 GMT

Thanks, @Yogeshprabhu

I changed my directory user/group structure to match yours and it appears to be working now.

I would say that this is a bug in the installation.

Re: Zeppelin notebook exception - HDFS permissions?

yjagadeesan — Tue, 24 May 2016 21:12:39 GMT

Good to know. Would you mind to mark this answer as solved?

Thanks @Zack Riesland