question How to configure Hue to work with Namenode HA, Resource Manager HA and Hive Server2 HA? in Support Questions

How to configure Hue to work with Namenode HA, Resource Manager HA and Hive Server2 HA?

pardeep_kumar — Tue, 29 Sep 2015 08:20:30 GMT

Re: How to configure Hue to work with Namenode HA, Resource Manager HA and Hive Server2 HA?

bleonhardi — Tue, 29 Sep 2015 09:17:01 GMT

Namenode HA: Needs installation of httpfs:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_hadoop-ha/content/ha-nn-deploy-hue.html

However in my installation was a bug that httpfs install would not create the /etc/init.d/httpfs scripts so I manually had to link the folder from the httpfs installation directory. After that it worked.

ResourceManager is pretty straight forward, it is written in the hue config.

HiveServer2 HA: Not sure I would suppose Hive2 over http and an load balancer like HA proxy ( that would also be the way for oozie, ( see the answer to the oozie ha configuration question. )

Re: How to configure Hue to work with Namenode HA, Resource Manager HA and Hive Server2 HA?

nsabharwal — Tue, 29 Sep 2015 23:36:47 GMT

This is taken from internal notes/wiki

Install hadoop-httpfs on the same node as hue (specific to my situation) httpfs will inherit most configuration form Hadoop's default config directory, so, as long as this is on a client host, it will find everything fine. In HDFS's core-site.xml add entries for hadoop.proxyuser.httpfs.{groups,hosts} (*) Restart HDFS In /etc/hue/conf/hue.ini, set

webhdfs_url = http://<httpfshost>:14000/webhdfs/v1/

fs_defaultfs = hdfs://<NN HA cluster name> Restart httpfs/hue.

Re: How to configure Hue to work with Namenode HA, Resource Manager HA and Hive Server2 HA?

rbalam — Fri, 12 Feb 2016 00:12:47 GMT

Hi @Neeraj Sabharwal

I followed the same steps and restarted httpfs and hue services but when I try to access hue filebrowser it is throwing exceptions. The only difference in this environment is hue is running on https and cluster is kerberized but not sure if it makes any difference. Can you please let me know how to trouble shoot this issue?

WebHdfsException at /filebrowser/

StandbyException: Operation category READ is not supported in state standby (error 403)

Django Version:
Request Method:	GET
Request URL:	https://falbdcdd0001v:8000/filebrowser/
Exception Type:	WebHdfsException
Exception Value:	StandbyException: Operation category READ is not supported in state standby (error 403)
Exception Location:	/usr/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py in _stats, line 205
Python Executable:	/usr/bin/python2.6
Python Version:

Re: How to configure Hue to work with Namenode HA, Resource Manager HA and Hive Server2 HA?

rbalam — Fri, 12 Feb 2016 00:40:06 GMT

I followed the same steps on another cluster where we dont have hue https and kerberos and it is working as expected there. So i think there is a problem with either https and/or kerberos settings.

Re: How to configure Hue to work with Namenode HA, Resource Manager HA and Hive Server2 HA?

nsabharwal — Fri, 12 Feb 2016 00:50:48 GMT

@rbalam Look at Benjamin comments.