Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Zeppelin does not write its notes in HDFS on HDP 2.6.3

avatar
Expert Contributor

After HDP 2.6.3 upgrade, I expect seeing Zeppelin starts updating its HDFS directory with new notes created since I was noticed in upgrade doc:

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-upgrade/content/upgrading_HDP_pre...

However, I don't see files or folders modified dates updated either new was created in HDFS.

I can't see any errors related to HDFS in Zeppelin log. HDFS log also does not contain any new lines for Zeppelin.

What I remember is I forgot copying notebook folder in HDFS in prerequisites step but did it after upgrade was completed. Then i restarted Zeppelin.

Do you have any idea about how I can make it write on HDFS?

Thanks in advance...

1 ACCEPTED SOLUTION

avatar
Super Guru

@Sedat Kestepe,

Is this a kerberized cluster?. Can you please check the below values.

1)zeppelin.notebook.storage is set to 'org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo' in Advanced zeppelin-config

2) If it is a kerberized cluster then add these two configs in Custom zeppelin-config

zeppelin.server.kerberos.keytab= /etc/security/keytabs/zeppelin.server.kerberos.keytab (default)

zeppelin.server.kerberos.principal=zeppelin@REALM.COM (default)

3) Check if this folder exist in HDFS /user/zeppelin/notebook

Make these changes and restart zeppelin.

View solution in original post

3 REPLIES 3

avatar
Super Guru

@Sedat Kestepe,

Is this a kerberized cluster?. Can you please check the below values.

1)zeppelin.notebook.storage is set to 'org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo' in Advanced zeppelin-config

2) If it is a kerberized cluster then add these two configs in Custom zeppelin-config

zeppelin.server.kerberos.keytab= /etc/security/keytabs/zeppelin.server.kerberos.keytab (default)

zeppelin.server.kerberos.principal=zeppelin@REALM.COM (default)

3) Check if this folder exist in HDFS /user/zeppelin/notebook

Make these changes and restart zeppelin.

avatar
Expert Contributor

Hello @Aditya Sirna,

Thank you, it worked.

Cluster is not Kerberized.

1) Value was: "org.apache.zeppelin.notebook.repo.GitNotebookRepo,org.apache.zeppelin.notebook.repo.VFSNotebookRepo"

I have added also FileSystemNotebookRepo and after restart it updated the directory with the new notebook.

May this requirement be missing in upgrade documentation?

avatar
Explorer

I am also getting a problem, i cannot save a notebook (HDP 2.6.5)

in the zeppelin ui i am getting:

"Couldn't checkpoint note revision: possibly storage doesn't support versioning. Please check the logs for more details."

in the log i get:

"WARN [2018-07-25 15:18:44,757] ({qtp1786364562-1678} FileSystemNotebookRepo.java[checkpoint]:159) - checkpoint is not implemented for HdfsNotebookRepo"

(not Kerberized)

can any one help?