Support Questions
Find answers, ask questions, and share your expertise

How to consume messages from Kafka with Nifi with PlainLoginModule

Highlighted

How to consume messages from Kafka with Nifi with PlainLoginModule

Hi

I have to consume Messages from a thirth party Kafka.

For the security they are using the security protocol `SASL_PLAINTEXT` with the sasl mechanism `PLAIN`.

With a native Java-Application I am able to consume messages by setting following configurations:

  • sasl.mechanism: PLAIN
  • security.protocol: SASL_PLAINTEXT
  • sasl.jaas.config (if not using JAAS-Conf-file): org.apache.kafka.common.security.plain.PlainLoginModule required username="myuser" password="mypassword"

Whenever I try to set the security protocol in the ConsumeKafka-Processor, I have to define a Kerberos Service Name.

So, is it possible to consume messages from such a system with Nifi?

If it's not possible, can you recommend me another solution?

Thanks

2 REPLIES 2
Highlighted

Re: How to consume messages from Kafka with Nifi with PlainLoginModule

Master Guru
@Marius Müller

You can will need to create a jaas file that Nifi will use to facilitate the "plain" connection.

http://bryanbende.com/development/2016/09/15/apache-nifi-and-apache-kafka

You may find the following information useful as well:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-10-nar/1.3.0/org.apac...

Thanks,

Matt

Highlighted

Re: How to consume messages from Kafka with Nifi with PlainLoginModule

Contributor

Hi,

Im  also facing same issue. can  you please help how do resolve this issue

Don't have an account?