Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

LLAP unable to decode data for zkpath/zknode

Highlighted

LLAP unable to decode data for zkpath/zknode

New Contributor

Hello All,

 

We're trying to get LLAP running on Hive 3.1.2/Hadoop 3.2.0 and I'm seeing some issues with possibly some configuration issue that I don't know where to proceed.

 

I'm running the hive --service llap .... to generate the run.sh and Yarnfile.  When I run the run.sh, it appears that llap successfully starts on the nodes (just have 2 for testing). I can see the  LlapDaemon running, don't see any errors in the LLAP logs, and when I query zookeeper directly I can see the workers.

 

get /llap-unsecure/user-hadoop/looker-llap/workers/worker-0000000028

{"type":"JSONServiceRecord","description":null,"external":[{"api":"services","addressType":"uri","protocolType":"webui","addresses":[{"uri":"http://<ip>:15002"}]}],"internal":[{"api":"llap","addressType":"host/port","protocolType":"hadoop/IPC","addresses":[{"host":"<ip>","port":"36949"}]},{"api":"llapmng","addressType":"host/port","protocolType":"hadoop/IPC","addresses":[{"host":"<ip>","port":"15004"}]},{"api":"shuffle","addressType":"host/port","protocolType":"tcp","addresses":[{"host":"<ip>","port":"15551"}]},{"api":"llapoutputformat","addressType":"host/port","protocolType":"hadoop/IPC","addresses":[{"host":"<ip>","port":"15003"}]}]}

cZxid = 0x100000180

ctime = Thu Sep 12 16:08:27 UTC 2019

mZxid = 0x100000180

mtime = Thu Sep 12 16:08:27 UTC 2019

pZxid = 0x100000180

cversion = 0

dataVersion = 0

aclVersion = 0

ephemeralOwner = 0x201b750ea21002b

dataLength = 764

numChildren = 0

 

Also when I curl the LLAP port, I get back that it's started:

curl localhost:15002/status

{

  "status" : "STARTED",

  "uptime" : 616474,

  "build" : "3.1.2 from 8190d2be7b7165effa62bd21b7d60ef81fb0e4af by gates source checksum 0492c08f784b188c349f6afb1d8d9847"

}

 

 

But when I do a hive --service llapstatus .....  I get the following error.  We see the same error when we're running Hive and try to access the LLAP Daemon via the Webui.  

 

ERROR impl.ZkRegistryBase: Unable to decode data for zknode: /user-hadoop/looker-llap/workers/worker-0000000028. Dropping notification of type: CHILD_ADDED

ERROR impl.ZkRegistryBase: Unable to decode data for zkpath: /user-hadoop/looker-llap/workers/worker-0000000028. Ignoring from current instances list..

ERROR impl.ZkRegistryBase: Unable to decode data for zkpath: /user-hadoop/looker-llap/workers/worker-0000000030. Ignoring from current instances list..

ERROR impl.ZkRegistryBase: Unable to decode data for zknode: /user-hadoop/looker-llap/workers/worker-0000000030. Dropping notification of type: CHILD_ADDED

 

LLAPSTATUS

--------------------------------------------------------------------------------

LLAP Starting up with AppId=application_1568253383078_0010. Started 0/2 instances

--------------------------------------------------------------------------------

LLAP Starting up with AppId=application_1568253383078_0010. Started 0/2 instances

--------------------------------------------------------------------------------

 

 

 

 

{

  "amInfo" : {

    "appName" : "looker-llap",

    "appType" : "yarn-service",

    "appId" : "application_1568253383078_0010"

  },

  "state" : "LAUNCHING",

  "desiredInstances" : 2,

  "liveInstances" : 0,

  "appStartTime" : 0,

  "runningThresholdAchieved" : false

}

 

 

Should there be /llap-secure/ prepended to this zkpath/zknode?  if so, what config. var do I set for this????

4 REPLIES 4

Re: LLAP unable to decode data for zkpath/zknode

New Contributor

I got the same problem. Have you had a resolution for the problem? Thanks.

Re: LLAP unable to decode data for zkpath/zknode

New Contributor
No I have not, unfortunately....If someone figures it out, I would love to
know the resolution.

Dan

Re: LLAP unable to decode data for zkpath/zknode

Rising Star

@dano-young  - Did you try to start the LLAP from the Ambari? Can you please share the error message you are while restarting the same from Ambari.  

Re: LLAP unable to decode data for zkpath/zknode

New Contributor
Hello,

We're not using Ambari, this is with Apache HIve and we're using ansible
for automation.
Don't have an account?
Coming from Hortonworks? Activate your account here