Member since
02-16-2016
45
Posts
24
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6260 | 07-28-2016 03:37 PM | |
9031 | 02-20-2016 11:34 PM |
02-08-2019
02:34 PM
@Geoffrey Shelton Okot No I still get the same error.
... View more
02-07-2019
10:47 PM
We are using SASL and Kerberos not SSL. Do you have any functioning SASL and Kerberos config?
... View more
02-07-2019
09:52 PM
@Geoffrey Shelton Okot It is a HDP cluster version: 2.6.5.4-1. I have a Kafka cluster with 6 brokers. listeners=SASL_PLAINTEXT://host.name:6667
advertised.listeners=SASL_PLAINTEXT://host.name:6667
sasl.enabled.mechanisms=GSSAPI
I do not see "sasl.kerberos.service.name" in server.properties I do see it in kafka_jaas.conf and kafka_client_jaas.conf being set to 'kafka'
... View more
02-07-2019
09:14 PM
@Geoffrey Shelton Okot Yes the Kafka cluster is secured with SASL and Kerberos. We just did this so it is the first time we are testing it. We followed Hortonwork's documentation to secure the cluster.
... View more
02-07-2019
08:39 PM
@Geoffrey Shelton Okot in the server.properties I see listeners=SASL_PLAINTEXT://host.name:6667
advertised.listeners=SASL_PLAINTEXT://host.name:6667 Do I need to change them? The cluster is secured and we are using SASL_PLAINTEXT not PLAINTEXT
... View more
02-07-2019
08:04 PM
I followed Producing Events/Messages to Kafka on a Secured Cluster. I am setting export KAFKA_CLIENT_KERBEROS_PARAMS="-Djava.security.auth.login.config=/usr/hdp/current/kafka-broker/config/kafka_client_jaas.conf" and passing --security-protocol SASL_PLAINTEXT my command looks like ./bin/kafka-console-producer.sh --broker-list <Brokker-hosts>:6667 --topic test --security-protocol SASL_PLAINTEXT
kafka_client_jaas.conf: KafkaClient {
com.sun.security.auth.module.Krb5LoginModule required
useTicketCache=true
renewTicket=true
serviceName="kafka";
};
kafka_jaas.conf: KafkaServer {
com.sun.security.auth.module.Krb5LoginModule required
useKeyTab=true
keyTab="/etc/security/keytabs/kafka.service.keytab"
storeKey=true
useTicketCache=false
serviceName="kafka"
principal="kafka/_host@EXAMPLE.COM";
};
KafkaClient {
com.sun.security.auth.module.Krb5LoginModule required
useTicketCache=true
renewTicket=true
serviceName="kafka";
};
Client {
com.sun.security.auth.module.Krb5LoginModule required
useKeyTab=true
keyTab="/etc/security/keytabs/kafka.service.keytab"
storeKey=true
useTicketCache=false
serviceName="zookeeper"
principal="kafka/_host@EXAMPLE.COM";
};
com.sun.security.jgss.krb5.initiate {
com.sun.security.auth.module.Krb5LoginModule required
renewTGT=false
doNotPrompt=true
useKeyTab=true
keyTab="/etc/security/keytabs/kafka.service.keytab"
storeKey=true
useTicketCache=false
serviceName="kafka"
principal="kafka/_host@EXAMPLE.COM";
};
When I run this I get the prompt to type my message but then I get: 19/02/07 13:35:52 WARN NetworkClient: Error while fetching metadata with correlation id 307 : {test=LEADER_NOT_AVAILABLE}
19/02/07 13:35:52 WARN NetworkClient: Error while fetching metadata with correlation id 308 : {test=LEADER_NOT_AVAILABLE}
19/02/07 13:35:52 WARN NetworkClient: Error while fetching metadata with correlation id 309 : {test=LEADER_NOT_AVAILABLE}
19/02/07 13:35:52 WARN NetworkClient: Error while fetching metadata with correlation id 310 : {test=LEADER_NOT_AVAILABLE}
19/02/07 13:35:52 WARN NetworkClient: Error while fetching metadata with correlation id 311 : {test=LEADER_NOT_AVAILABLE}
my Kafka version is : 1.0.0 I made sure that topic "test" exists and I can get the leader ids when I run describe How can I resolve this issue?
... View more
Labels:
- Labels:
-
Apache Kafka
07-28-2016
03:48 PM
I solved it by coping all the jar file in /usr/hdp/2.3.2.0-2950/atlas/hook/hive/* directory into lib folder at job.properties level.
... View more
07-28-2016
03:37 PM
I figure it out. I post the answer for others with same issue. The problem was missing atlas jar files.Try to copy all the jar file in /usr/hdp/2.3.2.0-2950/atlas/hook/hive/* directory into lib folder at job.properties level.
... View more
07-28-2016
03:36 PM
@Thiago I did! It took me one week but finally I figure it out! I will post it as an answer.
... View more
07-06-2016
05:01 PM
@mqureshi I add the jar file but I still get the same error. Do you have any other suggestion?
... View more