Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to configure standalone Ambari Files View to another cluster with NameNode HA

Solved Go to solution
Highlighted

How to configure standalone Ambari Files View to another cluster with NameNode HA

Someone recently asked me how to configure a standalone Ambari Server with the Files View to point correctly to a server running NameNode HA.

Whenever active/standby NameNodes switch roles, the Files View can correctly handle the transition.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: How to configure standalone Ambari Files View to another cluster with NameNode HA

On the cluster with the NameNodes, set these properties in HDFS for custom core-site,

hadoop.proxyuser.root.groups=*

hadoop.proxyuser.root.hosts=*

Navigate to http://server:8080/api/v1/clusters/$name/configurations?type=hdfs-site

click on the last config, and take note of several of the properties

On the standalone Ambari Server hosting the Views, create the Files View and configure it as follows,

  • WebHDFS FileSystem URI: webhdfs://$nameservice:50070
  • List of NameNodes: Value from dfs.ha.namenodes.$nameservice E.g., "nn1,nn2"
  • NameNode RPC Address: fqdn:8020 (comes from dfs.namenode.rpc-address.$nameservice.$nodename )
  • NameNdoe HTTP (WebHDFS) Address: fqdn:50070 (comes from dfs.namenode.http-address.$nameservice.$nodename )
  • Failover Proxy Provider: Value from dfs.client.failover.proxy.provider.$nameservice E.g., "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"

560-screen-shot-2015-11-23-at-60830-pm.png

Voila,

571-screen-shot-2015-11-23-at-61942-pm.png

View solution in original post

1 REPLY 1
Highlighted

Re: How to configure standalone Ambari Files View to another cluster with NameNode HA

On the cluster with the NameNodes, set these properties in HDFS for custom core-site,

hadoop.proxyuser.root.groups=*

hadoop.proxyuser.root.hosts=*

Navigate to http://server:8080/api/v1/clusters/$name/configurations?type=hdfs-site

click on the last config, and take note of several of the properties

On the standalone Ambari Server hosting the Views, create the Files View and configure it as follows,

  • WebHDFS FileSystem URI: webhdfs://$nameservice:50070
  • List of NameNodes: Value from dfs.ha.namenodes.$nameservice E.g., "nn1,nn2"
  • NameNode RPC Address: fqdn:8020 (comes from dfs.namenode.rpc-address.$nameservice.$nodename )
  • NameNdoe HTTP (WebHDFS) Address: fqdn:50070 (comes from dfs.namenode.http-address.$nameservice.$nodename )
  • Failover Proxy Provider: Value from dfs.client.failover.proxy.provider.$nameservice E.g., "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"

560-screen-shot-2015-11-23-at-60830-pm.png

Voila,

571-screen-shot-2015-11-23-at-61942-pm.png

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here