Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

oozie job in Hue can't find right ZK nodes

oozie job in Hue can't find right ZK nodes

Expert Contributor

oozie job in Hue can't find right zk nodes, please see the logs below:

2017-06-19 18:26:07,180 INFO [main] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5dcbb60 connecting to ZooKeeper ensemble=localhost:2181

i think you can see the ensemble = localhost:2181 ,  this is so strange to me , why is not my Zk configuration.

 

so when the job in execute on the nodes doesn't have ZK service, then it will try for long time and failed last. 

 

please check the below HUE configuration for zk, i have 5 zk nodes

 

ensemble

['datanode03.isesol.com:2181', 'datanode04.isesol.com:2181', 'datanode02.isesol.com:2181', 'cmserver.isesol.com:2181', 'datanode01.isesol.com:2181']

 

my spark program has set ZK property:

 

val config = HBaseConfiguration.create()
config.set("hbase.zookeeper.quorum", "datanode01.isesol.com,datanode02.isesol.com,datanode03.isesol.com,datanode04.isesol.com,cmserver.isesol.com")
config.set("hbase.zookeeper.property.clientPort", "2181")

 

 

anybody has this experience ?  how to configure HUE to find right zk nodes ?  this is 5.9 verion , i have countered this issue in pervious version .

 

 

2 REPLIES 2

Re: oozie job in Hue can't find right ZK nodes

Expert Contributor

another clue,  while i execute sqoop in command mode, it's ok.  checking the below logs ,we can see the ZK configuration is correct, why the issue happend while i deploy this job in oozie by Hue?

 

17/06/19 21:40:11 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181 sessionTimeout=60000 watcher=hconnection-0x6b5f87070x0, quorum=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181, baseZNode=/hbase
17/06/19 21:40:11 INFO zookeeper.ClientCnxn: Opening socket connection to server datanode04.isesol.com/10.215.4.167:2181. Will not attempt to authenticate using SASL (unknown error)

Highlighted

Re: oozie job in Hue can't find right ZK nodes

Expert Contributor
it seems got resolved. just add hbase-site.xml file 2017-06-20 01:43:02,739 INFO [main] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5dcbb60 connecting to ZooKeeper ensemble=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.9.0--1, built on 10/21/2016 08:08 GMT 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:host.name=datanode01.isesol.com 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.8.0_60