HBase installation issue in cluster

[#1]

Hi All,

I have a hadoop cluster setup with one master and two slave. I want to installed hbase in the cluster.

But when running hbase I hbase I am getting one error in zookeeper log file

<code>> 2016-07-11 22:49:18,199 WARN  [QuorumPeer[myid=0]/0.0.0.0:2181] quorum.QuorumCnxManager: Cannot open channel to 2 at election address /10.0.1.105:3888
java.net.ConnectException: Connection refused
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:579)
    at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:368)
    at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectAll(QuorumCnxManager.java:402)
    at org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:840)
    at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:762)
2016-07-11 22:49:18,201 WARN  [QuorumPeer[myid=0]/0.0.0.0:2181] quorum.QuorumCnxManager: Cannot open channel to 1 at election address /10.0.1.103:3888
java.net.ConnectException: Connection refused
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:579)
    at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectOne(QuorumCnxManager.java:368)
    at org.apache.zookeeper.server.quorum.QuorumCnxManager.connectAll(QuorumCnxManager.java:402)
    at org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:840)
    at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:762)
2016-07-11 22:49:18,201 INFO  [QuorumPeer[myid=0]/0.0.0.0:2181] quorum.FastLeaderElection: Notification time out: 25600
hduser@hadoopmaster:/home/$ 

But no error in salve.

My HBase-site.xml configuration is as follows ...

In Master

<code><configuration>

    <property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
    </property>

    <property>
        <name>hbase:rootdir</name>
        <value>hdfs://hadoopmaster:9000/hbase</value>
    </property>

    <property>
            <name>hbase.zookeeper.quorum</name>
        <value>10.0.1.104,10.0.1.103,10.0.1.105</value>
    </property>

    <property>
            <name>hbase.master</name> 
            <value>hadoopmaster:60000</value>
    </property>
    <property>
            <name>hbase.zookeeper.property.dataDir</name>
            <value>hdfs://hadoopmaster:9000/zookeeper</value>
    </property>

    <property>
            <name>hbase.zookeeper.property.clientPort</name>
            <value>2181</value>
    </property>

    <property> 
        <name>hbase.zookeeper.leaderport</name> 
        <value>3888</value> 
    </property>

In Slave

<code><configuration>

    <property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
    </property>

    <property>
        <name>hbase:rootdir</name>
        <value>hdfs://hadoopmaster:9000/hbase</value>
    </property>
    <property>
            <name>hbase.zookeeper.property.clientPort</name>
            <value>2181</value>
    </property>

    <property> 
        <name>hbase.zookeeper.leaderport</name> 
        <value>3888</value> 
    </property>

</configuration>

IP Address Details

10.0.1.104 --- hadoopmaster

10.0.1.103 --- hadoopslave2

10.0.1.105 --- hadoopslave1

Please note, I do not have firewall enabled in setup.

I am not using separate zookeepr installation rather I am using embed zookeeper installation that comes with HBASE.

Any one face this issue ?

Please suggest the way to resolve this issue.

Any help will be highly appropriated, Thanks in advance....

[#2]

I would highly recommend using Ambari to install your cluster to avoid future issues.

It looks like the ZooKeeper nodes cannot communicate with one another. Are 10.0.1.103 and 10.0.1.105 the proper IP addresses? Can the node which you copied the exception from reach the nodes specified by those IP address? Have you inspected if the other nodes have errors?

[#3 · Accepted solution]

Proper configuration name: hbase.rootdir

[#4]

thanks a lot.... my bad 😞 , a very bad silly mistake I did.....

[#5]

Can you check zookeeper log on 10.0.1.105? May be it failed to start.

[#6]

Please post zoo.cfg content. You may have wrong connection strings in config file:

server.1=

server.2=

server.3=

or zero max client connections (sometime it happens)