Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka Nifi Integration

Highlighted

Kafka Nifi Integration

Explorer

We have a 2 node test cluster where we Installed Kafka & Nifi.

Kafka brokers & Nifi running on both nodes .

I am very new to this setup. What ports need to be open.

How can a user access the cluster from his local machine and if possible can someone share a test from scratch.

I know my ask is too much. Its just that i want to get a good insight how this whole thing works and integrates.

I have gone through below article, but not sure where to start or how can i access kafka/nifi from my local machine:

https://community.hortonworks.com/content/kbentry/57262/integrating-apache-nifi-and-apache-kafka.htm...

1 REPLY 1
Highlighted

Re: Kafka Nifi Integration

Super Collaborator

The default ports are as follows

  • Kafka: 9092
  • NiFi: 8080
  • Zookeeper: 2181

You can access NiFi via the Web UI running on port 8080.

You can access Kafka from your local machine, outside of a broker by downloading the kafka package for your respective Kafka broker version, then run a command like this to see all the topics in the cluster.

kafka-topics --list --zookeeper yourZkServer:2181 

Perhaps, the Kafka Quickstart guide would be a good start for you. And you can extend that knowledge of produce/consume over to the NiFi UI. http://kafka.apache.org/quickstart

Don't have an account?
Coming from Hortonworks? Activate your account here