About klin

klin · ‎03-27-2017

thanks guy, Set the hbase.master.ipc.address to 0.0.0.0 solved my problem. Cheers,

klin · ‎03-26-2017

Hi all, I installed HBase from HDP-2.5.3.0. The master node has given the following error: Connection failed: [Errno 111] Connection refused to hmaster.mlx:16000 $ sudo netstat -tulpn | grep -E '16000' tcp 0 0 192.168.20.41:16000 0.0.0.0:* LISTEN 11615/java So the master node process binds to the cluster management interface only (which is not hmaster.mlx). I checked the hbase-site, and it has hbase.master.info.bindAddress set to 0.0.0.0 by default. Am I looking at the wrong property? But the RegionServer does bind to 0.0.0.0 though. $ sudo netstat -tulpn | grep -E '16030' [sudo] tcp 0 0 0.0.0.0:16030 0.0.0.0:* LISTEN 12320/java Any idea will be appriciated. Cheers, Derrick

klin · ‎03-23-2017

Hi all, I am wondering if there is a reliable way to tell the completion of a NodeManager decommission? For the DataNode decommission, I can do so by checking NameNode's log for completion. But it seems that there is no clear message from ResourceManager's log. Cheers,

klin · ‎03-14-2017

Thanks everyone, I read: Each server should have one consistent hostname on all interfaces. Theoretically, DNS allows a server to have a different hostname per network interface. But it is required[2] for multi-homed Hadoop clusters that each server have only one hostname, consistent among all network interfaces used by Hadoop. (Network interfaces excluded from use by Hadoop may allow other hostnames.) This is not the case on my environment, but that's OK. We will just register all nodes via 25GbE high speed network for now then. Thanks

klin · ‎03-13-2017

Hi all, I have a test ambari cluster. Each node has two interface 1GbE for management and 25GbE high speed for data. Both interfaces have had DNS/rDNS configured on a central DNS server. I have gone through this guide http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html and enabled those options through ambari. When adding a new dataNode, I specify its hostname of the management interface. I did few benchmark, and found that the HDFS does not use the 25GbE network at all. I am wondering if I am still missing something to fully enable multihoming for HDFS? Cheers, Derrick

Online	Offline
Last Visited	‎02-23-2021 07:03 PM

Date Registered	‎03-13-2017 01:40 AM
Last Visited	‎02-23-2021 07:03 PM
Total Messages Posted	5

Re: hbase.master.info.bindAddress has no effect on...

hbase.master.info.bindAddress has no effect on mas...

Re: I tried to decommission the NODEMANAGERS and D...

Re: Configure multihomed for HDFS to use high spee...

Configure multihomed for HDFS to use high speed ne...