Support Questions
Find answers, ask questions, and share your expertise

I am not able to consume data from ConsumeKafka_0_10 processor in nifi. Can anyone help me on this?

I am not able to consume data from ConsumeKafka_0_10 processor in nifi. Can anyone help me on this?

New Contributor

I have a HDF cluster from which i am trying to consume data from kafka deployed on another HDP cluster . The processor is just waiting and not consuming anything. Where as i am able to consume from console and able to produce using publishKafka_0_10. Please help me on this.

1 REPLY 1

Re: I am not able to consume data from ConsumeKafka_0_10 processor in nifi. Can anyone help me on this?

Mentor

@Rupesh Agarwal

To be able to communicate with another cluster your HDF should be made aware, ie First your HDP cluster should be reachable from the HDF cluster network ping etc

A file or comma-separated list of files which contains the Hadoop file system configuration to enable NiFi's PutHDFS processor to write data to HDFS configurable with your hdfs-site.xml and core-site.xml files.

Also, you will need to give parameters to your ConsumeKafka or GetKafka

Kafka Brokers 
Security Protocol     
Topic Name(s) 
Topic Name Format 
Honor Transactions 
Group ID Offset 
Reset Key 
Attribute Encoding

Just to mention but a few for full documentation see Apache nifi