Member since
03-13-2017
5
Posts
0
Kudos Received
0
Solutions
03-27-2017
01:30 AM
thanks guy, Set the hbase.master.ipc.address to 0.0.0.0 solved my problem. Cheers,
... View more
03-26-2017
10:18 PM
Hi all, I installed HBase from HDP-2.5.3.0. The master node has given the following error: Connection failed: [Errno 111] Connection refused to hmaster.mlx:16000 $ sudo netstat -tulpn | grep -E '16000' tcp 0 0 192.168.20.41:16000 0.0.0.0:* LISTEN 11615/java So the master node process binds to the cluster management interface only (which is not hmaster.mlx). I checked the hbase-site, and it has hbase.master.info.bindAddress set to 0.0.0.0 by default. Am I looking at the wrong property? But the RegionServer does bind to 0.0.0.0 though. $ sudo netstat -tulpn | grep -E '16030' [sudo] tcp 0 0 0.0.0.0:16030 0.0.0.0:* LISTEN 12320/java Any idea will be appriciated. Cheers, Derrick
... View more
Labels:
- Labels:
-
Apache HBase
03-23-2017
07:26 AM
Hi all, I am wondering if there is a reliable way to tell the completion of a NodeManager decommission? For the DataNode decommission, I can do so by checking NameNode's log for completion. But it seems that there is no clear message from ResourceManager's log. Cheers,
... View more
03-14-2017
02:45 AM
Thanks everyone, I read:
Each server should have one consistent hostname on all interfaces. Theoretically, DNS allows a server to have a different hostname per network interface. But it is required[2] for multi-homed Hadoop clusters that each server have only one hostname, consistent among all network interfaces used by Hadoop. (Network interfaces excluded from use by Hadoop may allow other hostnames.) This is not the case on my environment, but that's OK. We will just register all nodes via 25GbE high speed network for now then. Thanks
... View more
03-13-2017
02:03 AM
Hi all, I have a test ambari cluster. Each node has two interface 1GbE for management and 25GbE high speed for data. Both interfaces have had DNS/rDNS configured on a central DNS server. I have gone through this guide http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html and enabled those options through ambari. When adding a new dataNode, I specify its hostname of the management interface. I did few benchmark, and found that the HDFS does not use the 25GbE network at all. I am wondering if I am still missing something to fully enable multihoming for HDFS? Cheers, Derrick
... View more
Labels:
- Labels:
-
Apache Hadoop