Unable to get offset lags for kafka. Reason: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode

[#1]

Hello,

I use KafkaSpout to consume from a topic & I see the data being consumed & processed by topology as expected but the StormUI always shows the below exception. When I navigate to Zookeeper I do find the node & partitions. But once I navigate to the partitions I do not see any offset/data being saved in other words "partitions" folder is empty.

Unable to get offset lags for kafka. Reason: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode

I use storm-core V1.2.2, storm-kafka V1.2.2, kafka_2.12 V1.1.1 as maven dependencies.

Could you please help resolve this issue?

[#2]

Hello @Usha V!
Not sure if it's your case, but take a look at this thread at HCC:

https://community.hortonworks.com/questions/70743/storm-error-reading-form-kafka-after-upgrade-to-hd...

Let me know if it works 🙂

ps: if you still face this issue after the attempt above, then please share with us the whole log.

Hope this helps!

[#3]

@Vinicius Higa Murakami

The solution posted didn't work for me. Here's the stack trace:

Unable to get offset lags for kafka. Reason: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topicname/partitions at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1590) at org.apache.curator.shaded.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:242) at org.apache.curator.shaded.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:231) at org.apache.curator.shaded.connection.StandardConnectionHandlingPolicy.callWithRetry(StandardConnectionHandlingPolicy.java:64) at org.apache.curator.shaded.RetryLoop.callWithRetry(RetryLoop.java:100) at org.apache.curator.shaded.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:228) at org.apache.curator.shaded.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:219) at org.apache.curator.shaded.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:41) at org.apache.storm.kafka.monitor.KafkaOffsetLagUtil.getLeadersAndTopicPartitions(KafkaOffsetLagUtil.java:323) at org.apache.storm.kafka.monitor.KafkaOffsetLagUtil.getOffsetLags(KafkaOffsetLagUtil.java:257) at org.apache.storm.kafka.monitor.KafkaOffsetLagUtil.main(KafkaOffsetLagUtil.java:126)

[#4]

Hello @Usha V!
Are you running this in a secured cluster?

And also, do you mind to share with us the nimbus.log?

[#5]

@Vinicius Higa Murakami

No we are not running a secured cluster. Here are the lines from nimbus.out:

"Running: /usr/java/latest/bin/java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/hdf/3.1.2.0-7/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdf/current/storm-client/lib -Dstorm.conf.file= -cp /usr/hdf/3.1.2.0-7/storm/*:/usr/hdf/3.1.2.0-7/storm/lib/*:/usr/hdf/3.1.2.0-7/storm/extlib/*:/usr/hdf/3.1.2.0-7/storm/extlib-daemon/*:/*:/usr/hdf/current/storm-nimbus/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/hdf/3.1.2.0-7/storm/log4j2/cluster.xml org.apache.storm.daemon.nimbus"

I do not see anything relevant in nimbus.log