09-18-2017 10:01 AM - edited 09-18-2017 10:02 AM
That documentation is correct. The flume kafka client version that is in CDH5.7 and lower isn't capable of communicating with secure kafka. You need to upgrade to CDH5.8 or higher version of flume in order to be able to connect to secure kafka, and use these steps to configure flume: https://www.cloudera.com/documentation/enterprise/latest/topics/cm_mc_flume_kafka_security_confg.htm...
09-19-2017 02:59 AM
Thanks PD for the confirmation
can you please let me know technically what change we are going to do in Flume or Kafka side to make it work over kerberos on versions > 5.7
09-19-2017 12:16 PM - edited 09-19-2017 12:16 PM
As I stated in my recent comment, the flume kafka client was upgraded as a part of the CDH5.8 upgrade to be able to use the new consumer API, which supports secure communication with kerberos. Versions prior to CDH5.8 use the old api which doesn't support kerberos or SSL.
You will have to upgrade to get this new functionality, or run flume outside of Cloudera Manager, using tarballs or RPM's.