Reply
Highlighted
Explorer
Posts: 10
Registered: ‎09-07-2017

Re: Kafka.properties override for listeners property fails

Cloudera Team

 

can I get the confirmation on this Product Limitations pls.

 

thanks

Deepak

Cloudera Employee
Posts: 221
Registered: ‎01-09-2014

Re: Kafka.properties override for listeners property fails

[ Edited ]

That documentation is correct. The flume kafka client version that is in CDH5.7 and lower isn't capable of communicating with secure kafka. You need to upgrade to CDH5.8 or higher version of flume in order to be able to connect to secure kafka, and use these steps to configure flume: https://www.cloudera.com/documentation/enterprise/latest/topics/cm_mc_flume_kafka_security_confg.htm...


-pd

Explorer
Posts: 10
Registered: ‎09-07-2017

Re: Kafka.properties override for listeners property fails

Thanks PD for the confirmation

 

Appreciate that

 

can you please let me know technically what change we are going to do  in Flume or Kafka side to make it work over kerberos on versions > 5.7

Explorer
Posts: 10
Registered: ‎09-07-2017

Re: Kafka.properties override for listeners property fails

I want to know why the current version is not suppoirting and what change has been done to make it work ?

Cloudera Employee
Posts: 221
Registered: ‎01-09-2014

Re: Kafka.properties override for listeners property fails

[ Edited ]

As I stated in my recent comment, the flume kafka client was upgraded as a part of the CDH5.8 upgrade to be able to use the new consumer API, which supports secure communication with kerberos. Versions prior to CDH5.8 use the old api which doesn't support kerberos or SSL.

You will have to upgrade to get this new functionality, or run flume outside of Cloudera Manager, using tarballs or RPM's.

-pd

Announcements