Support Questions
Find answers, ask questions, and share your expertise

Zeppelin does not write its notes in HDFS on HDP 2.6.3

Solved Go to solution
Highlighted

Zeppelin does not write its notes in HDFS on HDP 2.6.3

Rising Star

After HDP 2.6.3 upgrade, I expect seeing Zeppelin starts updating its HDFS directory with new notes created since I was noticed in upgrade doc:

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-upgrade/content/upgrading_HDP_pre...

However, I don't see files or folders modified dates updated either new was created in HDFS.

I can't see any errors related to HDFS in Zeppelin log. HDFS log also does not contain any new lines for Zeppelin.

What I remember is I forgot copying notebook folder in HDFS in prerequisites step but did it after upgrade was completed. Then i restarted Zeppelin.

Do you have any idea about how I can make it write on HDFS?

Thanks in advance...

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Zeppelin does not write its notes in HDFS on HDP 2.6.3

@Sedat Kestepe,

Is this a kerberized cluster?. Can you please check the below values.

1)zeppelin.notebook.storage is set to 'org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo' in Advanced zeppelin-config

2) If it is a kerberized cluster then add these two configs in Custom zeppelin-config

zeppelin.server.kerberos.keytab= /etc/security/keytabs/zeppelin.server.kerberos.keytab (default)

zeppelin.server.kerberos.principal=zeppelin@REALM.COM (default)

3) Check if this folder exist in HDFS /user/zeppelin/notebook

Make these changes and restart zeppelin.

View solution in original post

3 REPLIES 3
Highlighted

Re: Zeppelin does not write its notes in HDFS on HDP 2.6.3

@Sedat Kestepe,

Is this a kerberized cluster?. Can you please check the below values.

1)zeppelin.notebook.storage is set to 'org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo' in Advanced zeppelin-config

2) If it is a kerberized cluster then add these two configs in Custom zeppelin-config

zeppelin.server.kerberos.keytab= /etc/security/keytabs/zeppelin.server.kerberos.keytab (default)

zeppelin.server.kerberos.principal=zeppelin@REALM.COM (default)

3) Check if this folder exist in HDFS /user/zeppelin/notebook

Make these changes and restart zeppelin.

View solution in original post

Highlighted

Re: Zeppelin does not write its notes in HDFS on HDP 2.6.3

Rising Star

Hello @Aditya Sirna,

Thank you, it worked.

Cluster is not Kerberized.

1) Value was: "org.apache.zeppelin.notebook.repo.GitNotebookRepo,org.apache.zeppelin.notebook.repo.VFSNotebookRepo"

I have added also FileSystemNotebookRepo and after restart it updated the directory with the new notebook.

May this requirement be missing in upgrade documentation?

Re: Zeppelin does not write its notes in HDFS on HDP 2.6.3

Explorer

I am also getting a problem, i cannot save a notebook (HDP 2.6.5)

in the zeppelin ui i am getting:

"Couldn't checkpoint note revision: possibly storage doesn't support versioning. Please check the logs for more details."

in the log i get:

"WARN [2018-07-25 15:18:44,757] ({qtp1786364562-1678} FileSystemNotebookRepo.java[checkpoint]:159) - checkpoint is not implemented for HdfsNotebookRepo"

(not Kerberized)

can any one help?