Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

GetKafka not getting messages in Apache Nifi

Solved Go to solution

GetKafka not getting messages in Apache Nifi

New Contributor

I'm trying to get the messages using a GetKafka processor but I'm not able to get it. I tested consuming messages using Kafka command line consumer and it works. I was also able to use PutKafka processor successfully to put the messages in the topic. Attached my settings where I set the Zookeeper Connection String and Topic Name. When I run the flow, I don't see any errors in the processors.

6304-nifi.jpg

I see an exception in nifi-app.log: 2016-08-03 09:34:33,722 WARN [70e1df87-6097-4ed0-9a40-7e36f9be6921_mydomain.com-1470231250839-1fbd0cfe-leader-finder-thread] kafka.client.ClientUtils$ Fetching topic metadata with correlation id 0 for topics [Set(test)] from broker [id:0,host:DataSlave1.mydomain.com, port:9092] failed java.nio.channels.ClosedByInterruptException: null at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202) ~[na:1.8.0_101] at sun.nio.ch.SocketChannelImpl.poll(SocketChannelImpl.java:957) ~[na:1.8.0_101]

Versions: Kafka (0.8): 2.10-0.8.2.1, Nifi: 0.7.0 Am I missing anything?

Also tested with Kafka 0.10 and had the same problem. Thanks.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: GetKafka not getting messages in Apache Nifi

2 REPLIES 2
Highlighted

Re: GetKafka not getting messages in Apache Nifi

Highlighted

Re: GetKafka not getting messages in Apache Nifi

Hi @john doe

I recently ran PutKafka and GetKafka in NiFi (connecting to a local VM). I found that adding the FQDN and ip to /etc/hosts made this work for me.

For example if the FQDN is host1.local and IP is 192.168.4.162 then adding

192.168.4.162 host1.local to /etc/hosts

Made this work.

Don't have an account?
Coming from Hortonworks? Activate your account here