Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Zeppelin notebook fails - HDP 2.5 on Azure

Highlighted

Zeppelin notebook fails - HDP 2.5 on Azure

Following are my issues

I have hosted HDP 2.5 on Azure. I am able to successfully access Ambari,Hive,Pig etc. I have issue with Zeppeling Notebook view. I am not seeing this view option on maria_dev. Also, when i try to directly access the url(tried localhost,my sandbox ip) with port 9995, i am getting DNS error.

Part of the log is pasted here

2017-03-07 19:27:42,748 - call returned (0, '')
2017-03-07 19:27:42,749 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin?op=SETOWNER&user.name=hdfs&owner=zeppelin&group='"'"' 1>/tmp/tmpvj_CBn 2>/tmp/tmpCbohij''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:42,790 - call returned (0, '')
2017-03-07 19:27:42,791 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin?op=GETCONTENTSUMMARY&user.name=hdfs'"'"' 1>/tmp/tmpIHgEeA 2>/tmp/tmp2OiKKl''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:42,825 - call returned (0, '')
2017-03-07 19:27:42,827 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin?op=LISTSTATUS&user.name=hdfs'"'"' 1>/tmp/tmpRoQdZP 2>/tmp/tmpBM7rmM''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:42,861 - call returned (0, '')
2017-03-07 19:27:42,862 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin/test?op=LISTSTATUS&user.name=hdfs'"'"' 1>/tmp/tmpilSGfN 2>/tmp/tmpw9qdBj''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:42,900 - call returned (0, '')
2017-03-07 19:27:42,901 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin/test?op=SETOWNER&user.name=hdfs&owner=zeppelin&group='"'"' 1>/tmp/tmpkDAGPg 2>/tmp/tmpt4wVVx''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:42,949 - call returned (0, '')
2017-03-07 19:27:42,950 - HdfsResource['/user/zeppelin/test'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'default_fs': 'hdfs://sandbox.hortonworks.com:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'owner': 'zeppelin', 'recursive_chown': True, 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'directory', 'action': ['create_on_execute'], 'recursive_chmod': True}
2017-03-07 19:27:42,951 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin/test?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpsK7QWY 2>/tmp/tmp4h_HGv''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:42,986 - call returned (0, '')
2017-03-07 19:27:42,987 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin/test?op=SETOWNER&user.name=hdfs&owner=zeppelin&group='"'"' 1>/tmp/tmp9xL52I 2>/tmp/tmpjM_L4t''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,025 - call returned (0, '')
2017-03-07 19:27:43,026 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin/test?op=GETCONTENTSUMMARY&user.name=hdfs'"'"' 1>/tmp/tmpbm2m0x 2>/tmp/tmp4OcRmP''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,061 - call returned (0, '')
2017-03-07 19:27:43,062 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/user/zeppelin/test?op=LISTSTATUS&user.name=hdfs'"'"' 1>/tmp/tmpLZSXgG 2>/tmp/tmpuQLbZi''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,097 - call returned (0, '')
2017-03-07 19:27:43,098 - HdfsResource['/apps/zeppelin'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'default_fs': 'hdfs://sandbox.hortonworks.com:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'owner': 'zeppelin', 'recursive_chown': True, 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'directory', 'action': ['create_on_execute'], 'recursive_chmod': True}
2017-03-07 19:27:43,099 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/apps/zeppelin?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmplxU6q3 2>/tmp/tmpDBcDSj''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,133 - call returned (0, '')
2017-03-07 19:27:43,134 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/apps/zeppelin?op=SETOWNER&user.name=hdfs&owner=zeppelin&group='"'"' 1>/tmp/tmpJI6b8T 2>/tmp/tmppmwIcw''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,178 - call returned (0, '')
2017-03-07 19:27:43,179 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/apps/zeppelin?op=GETCONTENTSUMMARY&user.name=hdfs'"'"' 1>/tmp/tmp3KsYnj 2>/tmp/tmpKvHbWl''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,213 - call returned (0, '')
2017-03-07 19:27:43,214 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/apps/zeppelin?op=LISTSTATUS&user.name=hdfs'"'"' 1>/tmp/tmpSrsFnb 2>/tmp/tmpZe_p6G''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,257 - call returned (0, '')
2017-03-07 19:27:43,259 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X PUT '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/apps/zeppelin/zeppelin-spark-dependencies-0.6.0.2.5.0.0-1245.jar?op=SETOWNER&user.name=hdfs&owner=zeppelin&group='"'"' 1>/tmp/tmpndLZ95 2>/tmp/tmp8Jjptg''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,297 - call returned (0, '')
2017-03-07 19:27:43,298 - HdfsResource['/apps/zeppelin/zeppelin-spark-dependencies-0.6.0.2.5.0.0-1245.jar'] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'source': '/usr/hdp/current/zeppelin-server/interpreter/spark/dep/zeppelin-spark-dependencies-0.6.0.2.5.0.0-1245.jar', 'default_fs': 'hdfs://sandbox.hortonworks.com:8020', 'replace_existing_files': True, 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'owner': 'zeppelin', 'group': 'zeppelin', 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf', 'type': 'file', 'action': ['create_on_execute'], 'mode': 0444}
2017-03-07 19:27:43,299 - call['ambari-sudo.sh su hdfs -l -s /bin/bash -c 'curl -sS -L -w '"'"'%{http_code}'"'"' -X GET '"'"'http://sandbox.hortonworks.com:50070/webhdfs/v1/apps/zeppelin/zeppelin-spark-dependencies-0.6.0.2.5.0.0-1245.jar?op=GETFILESTATUS&user.name=hdfs'"'"' 1>/tmp/tmpm27gID 2>/tmp/tmpDVCkiG''] {'logoutput': None, 'quiet': False}
2017-03-07 19:27:43,331 - call returned (0, '')
2017-03-07 19:27:43,331 - DFS file /apps/zeppelin/zeppelin-spark-dependencies-0.6.0.2.5.0.0-1245.jar is identical to /usr/hdp/current/zeppelin-server/interpreter/spark/dep/zeppelin-spark-dependencies-0.6.0.2.5.0.0-1245.jar, skipping the copying
2017-03-07 19:27:43,332 - HdfsResource[None] {'security_enabled': False, 'hadoop_bin_dir': '/usr/hdp/current/hadoop-client/bin', 'keytab': [EMPTY], 'default_fs': 'hdfs://sandbox.hortonworks.com:8020', 'hdfs_resource_ignore_file': '/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': ..., 'kinit_path_local': 'kinit', 'principal_name': [EMPTY], 'user': 'hdfs', 'action': ['execute'], 'hadoop_conf_dir': '/usr/hdp/current/hadoop-client/conf'}
2017-03-07 19:27:43,340 - File['/etc/zeppelin/conf/interpreter.json'] {'content': ..., 'owner': 'zeppelin', 'group': 'zeppelin'}
2017-03-07 19:27:43,340 - Writing File['/etc/zeppelin/conf/interpreter.json'] because contents don't match
2017-03-07 19:27:43,341 - Execute['/usr/hdp/current/zeppelin-server/bin/zeppelin-daemon.sh restart >> /var/log/zeppelin/zeppelin-setup.log'] {'user': 'zeppelin'}
2017-03-07 19:27:45,036 - Pid file is: /var/run/zeppelin/zeppelin-zeppelin-sandbox.hortonworks.com.pid

Command completed successfully!

Please help.

2 REPLIES 2
Highlighted

Re: Zeppelin notebook fails - HDP 2.5 on Azure

Mentor

You need to open the port 9995 in Azure in the endpoints location or alternatively configure tunneling as is in this tutorial

https://hortonworks.com/hadoop-tutorial/lap-around-deploying-managing-configuring-hdp-ambari-1-7/

Highlighted

Re: Zeppelin notebook fails - HDP 2.5 on Azure

New Contributor

Thank you! Opened up the port 9995 in Azure (add Inbound port rule that is under Networking). Zepplin started working on that port now.

Don't have an account?
Coming from Hortonworks? Activate your account here