Created 02-29-2024 02:12 AM
when try to create topic after enable TLS
kafka-topics --create --topic demo --bootstrap-server 192.168.1.235:9093 --partitions 3 --replication-factor 3
this command give me this error
also when try to add role like kafka-connect didn't start because this error below.
Stopping due to error
org.apache.kafka.connect.errors.ConnectException: Failed to connect to and describe Kafka cluster. Check worker's broker connection and security properties.
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64)
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:45)
at org.apache.kafka.connect.cli.ConnectDistributed.startConnect(ConnectDistributed.java:95)
at org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:78)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1709200849909) timed out at 1709200849951 after 1 attempt(s)
at org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
at org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
at org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:58)
... 3 more
Caused by: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1709200849909) timed out at 1709200849951 after 1 attempt(s)
Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment.
Created 03-02-2024 08:46 AM
@Loaimohamed79 please restart cloudera-scm-agent on all the kafka instances and check if you are still see this error.
Were u able to run this command before enabling it?
Created 03-03-2024 05:07 AM
I did that but still have the same error.
Yes, it was work before enable it.
Created 03-10-2024 12:10 AM
I see you cannot create the topics after enabling the TLS and it failed with the TimeoutException.
Since you have enabled the TLS, 'listeners' property must be using SASL_SSL or SSL protocol and hence with the 'kafka-topics' command you will need to use the argument --command-config and pass the client.properties file that includes the below properties,
---
security.protocol=SASL_SSL OR SSL
sasl.kerberos.service.name=kafka
ssl.truststore.location=<truststore-location>
---
So the command will look like,
kafka-topics --create --topic demo --bootstrap-server 192.168.1.235:9093 --partitions 3 --replication-factor 3 --command-config <client.properties-file-location>
Kindly follow these steps and let us know if it helps.