Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

kafka sasl_ssl plaintext connection issue

avatar
Expert Contributor

Hi,

 

I'm trying to access kafka broker from nifi using consume_kafka_record_2.0 and kafka has been configured sasl_ssl plaintext manner data needs to consume; While connection on this we facing below stacktrace issue, can you please help me out from this issue;

 

Processor configuration;aaa.png

 

 

2020-10-30 08:52:38,470 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:39,427 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:40,331 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:41,235 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:42,441 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:43,597 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:44,501 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:45,605 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:46,520 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:47,526 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.
2020-10-30 08:52:48,536 WARN [Timer-Driven Process Thread-8] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-20, groupId=devtest_grp11111] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.

3 REPLIES 3

avatar
Master Mentor

@varun_rathinam 

 

Is your nifi cluster kerberized if so you will need to provide the keytabs

avatar
Expert Contributor

Nope @Shelton . Its not kerberized one normal sasl security protocol with sasl.mechanishm plain text only. But i get this error look like this i have tried new nifi version also;

2020-10-31 23:36:16,762 WARN [Timer-Driven Process Thread-5] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-derfsdfdsf-2, groupId=derfsdfdsf] Connection to node -1 (xxxx:9092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue.
 
 
-----
2020-10-30 05:41:18,794 WARN [Timer-Driven Process Thread-6] org.apache.kafka.clients.NetworkClient [Consumer clientId=consumer-2, groupId=devtes_grp] Connection to node -1 terminated during authentication. This may indicate that authentication failed due to invalid credentials.-

avatar
New Contributor

Hi @varun_rathinam  . Were you able to solve the above error by any chance ? 

 

This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue.