Support Questions

Find answers, ask questions, and share your expertise

Zeppelin does not write its notes in HDFS on HDP 2.6.3

avatar
Expert Contributor

After HDP 2.6.3 upgrade, I expect seeing Zeppelin starts updating its HDFS directory with new notes created since I was noticed in upgrade doc:

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-upgrade/content/upgrading_HDP_pre...

However, I don't see files or folders modified dates updated either new was created in HDFS.

I can't see any errors related to HDFS in Zeppelin log. HDFS log also does not contain any new lines for Zeppelin.

What I remember is I forgot copying notebook folder in HDFS in prerequisites step but did it after upgrade was completed. Then i restarted Zeppelin.

Do you have any idea about how I can make it write on HDFS?

Thanks in advance...

1 ACCEPTED SOLUTION

avatar
Super Guru

@Sedat Kestepe,

Is this a kerberized cluster?. Can you please check the below values.

1)zeppelin.notebook.storage is set to 'org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo' in Advanced zeppelin-config

2) If it is a kerberized cluster then add these two configs in Custom zeppelin-config

zeppelin.server.kerberos.keytab= /etc/security/keytabs/zeppelin.server.kerberos.keytab (default)

zeppelin.server.kerberos.principal=zeppelin@REALM.COM (default)

3) Check if this folder exist in HDFS /user/zeppelin/notebook

Make these changes and restart zeppelin.

View solution in original post

3 REPLIES 3

avatar
Super Guru

@Sedat Kestepe,

Is this a kerberized cluster?. Can you please check the below values.

1)zeppelin.notebook.storage is set to 'org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo' in Advanced zeppelin-config

2) If it is a kerberized cluster then add these two configs in Custom zeppelin-config

zeppelin.server.kerberos.keytab= /etc/security/keytabs/zeppelin.server.kerberos.keytab (default)

zeppelin.server.kerberos.principal=zeppelin@REALM.COM (default)

3) Check if this folder exist in HDFS /user/zeppelin/notebook

Make these changes and restart zeppelin.

avatar
Expert Contributor

Hello @Aditya Sirna,

Thank you, it worked.

Cluster is not Kerberized.

1) Value was: "org.apache.zeppelin.notebook.repo.GitNotebookRepo,org.apache.zeppelin.notebook.repo.VFSNotebookRepo"

I have added also FileSystemNotebookRepo and after restart it updated the directory with the new notebook.

May this requirement be missing in upgrade documentation?

avatar
Explorer

I am also getting a problem, i cannot save a notebook (HDP 2.6.5)

in the zeppelin ui i am getting:

"Couldn't checkpoint note revision: possibly storage doesn't support versioning. Please check the logs for more details."

in the log i get:

"WARN [2018-07-25 15:18:44,757] ({qtp1786364562-1678} FileSystemNotebookRepo.java[checkpoint]:159) - checkpoint is not implemented for HdfsNotebookRepo"

(not Kerberized)

can any one help?