I have a HDF cluster from which i am trying to consume data from kafka deployed on another HDP cluster . The processor is just waiting and not consuming anything. Where as i am able to consume from console and able to produce using publishKafka_0_10. Please help me on this.
To be able to communicate with another cluster your HDF should be made aware, ie First your HDP cluster should be reachable from the HDF cluster network ping etc
A file or comma-separated list of files which contains the Hadoop file system configuration to enable NiFi's PutHDFS processor to write data to HDFS configurable with your hdfs-site.xml and core-site.xml files.
Also, you will need to give parameters to your ConsumeKafka or GetKafka
Kafka Brokers Security Protocol Topic Name(s) Topic Name Format Honor Transactions Group ID Offset Reset Key Attribute Encoding