Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka on Edge Node in cloudera cluster

Kafka on Edge Node in cloudera cluster

Contributor

Hi,

 

We will be creating a Hadoop cluster with Edge node using cloudera manager 5.8. We will setup spark gateway, Impala Daemon, HDFS Gateway, Hive gateway and Hue Server on Edge node to communicate with master nodes. We have  a query related to Kafka, We have setup Kafka Brokers on 3 servers but not on Edge node as it will be wrong in principal.

 

How can we setup kafka client libs on edge node as we will be running the consumer from Edge node as well as will run the adhoc kafka commands like[/usr/bin/kafka-topics --list --zookeeper IP:2181] . Do we need to simply copy the kafka files[e.g. kafka-topics, kafka-console-consumer] under /usr/bin/ to the edge node at same location?

 

Can you please help us on the same.

 

Thanks,

Amit

2 REPLIES 2

Re: Kafka on Edge Node in cloudera cluster

Contributor
Hi, can anybody please help me on the same.

Thanks,
Amit

Re: Kafka on Edge Node in cloudera cluster

Cloudera Employee

This seems to be a kakfa specific issue. I suggest you post your question to Data Ingestions & Integration (Apache Kafka, Apache Sqoop, Apache Flume...), which is a better forum to cover Kafka specific questions.