Reply
Expert Contributor
Posts: 152
Registered: ‎09-29-2014

oozie job in Hue can't find right ZK nodes

oozie job in Hue can't find right zk nodes, please see the logs below:

2017-06-19 18:26:07,180 INFO [main] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5dcbb60 connecting to ZooKeeper ensemble=localhost:2181

i think you can see the ensemble = localhost:2181 ,  this is so strange to me , why is not my Zk configuration.

 

so when the job in execute on the nodes doesn't have ZK service, then it will try for long time and failed last. 

 

please check the below HUE configuration for zk, i have 5 zk nodes

 

ensemble

['datanode03.isesol.com:2181', 'datanode04.isesol.com:2181', 'datanode02.isesol.com:2181', 'cmserver.isesol.com:2181', 'datanode01.isesol.com:2181']

 

my spark program has set ZK property:

 

val config = HBaseConfiguration.create()
config.set("hbase.zookeeper.quorum", "datanode01.isesol.com,datanode02.isesol.com,datanode03.isesol.com,datanode04.isesol.com,cmserver.isesol.com")
config.set("hbase.zookeeper.property.clientPort", "2181")

 

 

anybody has this experience ?  how to configure HUE to find right zk nodes ?  this is 5.9 verion , i have countered this issue in pervious version .

 

 

Expert Contributor
Posts: 152
Registered: ‎09-29-2014

Re: oozie job in Hue can't find right ZK nodes

another clue,  while i execute sqoop in command mode, it's ok.  checking the below logs ,we can see the ZK configuration is correct, why the issue happend while i deploy this job in oozie by Hue?

 

17/06/19 21:40:11 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181 sessionTimeout=60000 watcher=hconnection-0x6b5f87070x0, quorum=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181, baseZNode=/hbase
17/06/19 21:40:11 INFO zookeeper.ClientCnxn: Opening socket connection to server datanode04.isesol.com/10.215.4.167:2181. Will not attempt to authenticate using SASL (unknown error)

Expert Contributor
Posts: 152
Registered: ‎09-29-2014

Re: oozie job in Hue can't find right ZK nodes

it seems got resolved. just add hbase-site.xml file 2017-06-20 01:43:02,739 INFO [main] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5dcbb60 connecting to ZooKeeper ensemble=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.9.0--1, built on 10/21/2016 08:08 GMT 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:host.name=datanode01.isesol.com 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.8.0_60
Announcements