Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Metron is not receiving data from Kafka

Metron is not receiving data from Kafka

Explorer

I have NiFi set up to publish logs into Kafka topics. The publishing of the logs to Kafka topics is working fine, but when I create a sensor in Metron Management UI, it is not receiving any of the data that is being published into the kafka topics.

HarshR_0-1593988372335.png

I can see the logs as well when I use the kafka-console-consumer.sh script.

 

When I create the metron sensor, it automatically creates a storm parser and I can see it in the Storm UI page. But I do not see any of the logs in Metron or Storm. Is this a kafkaSpout issue? Possible settings within Metron that need to be changed? What do I need to do here?

 

HarshR_1-1593988512770.png

 

(as you can see, there are 3 running sensors, but no throughput for the 3 kafka topics)

 

Can somebody point me in the direction to a solution for this please?

1 REPLY 1
Highlighted

Re: Metron is not receiving data from Kafka

Explorer
Don't have an account?
Coming from Hortonworks? Activate your account here