Member since
10-04-2017
113
Posts
11
Kudos Received
9
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
18195 | 07-03-2019 08:34 AM | |
2088 | 10-31-2018 02:16 AM | |
12810 | 05-11-2018 01:31 AM | |
8434 | 02-21-2018 03:25 AM | |
2925 | 02-21-2018 01:18 AM |
09-12-2018
04:58 AM
2 Kudos
In that case the balancer can be run later, but the compaction may still help with keeping the HBase application request latency low, if that is an immediate concern in the cluster.
... View more
08-30-2018
04:46 AM
poojary_sudth: Thank you, but that is +- the same set of tasks I did before. I found how to make consumer work, it was necessary to add parameter --partition 0: KAFKA_OPTS="-Djava.security.auth.login.config=/root/jaas.conf" kafka-console-consumer --bootstrap-server ourHost:9092 --topic test --consumer.config /root/client.properties --partition 0 I cannot see all the messages comming into the topic, but at least some of them which fall into specified partition are printed. Which is enought for me to confirm that Kafka broker works. I found this hint here: https://stackoverflow.com/questions/34844209/consumer-not-receiving-messages-kafka-console-new-consumer-api-kafka-0-9
... View more
06-21-2018
07:48 AM
You should not worry for compatibility between KTS and CDH If you check https://www.cloudera.com/documentation/enterprise/latest/topics/encryption_ref_arch.html#concept_npk_rxh_1v CDH connects to KMS. KMS will connect to KTS So you have to check whether the KMS which is compatible to KTS3.8, is compatible with CDH5.14.2.
... View more
05-11-2018
01:31 AM
Issue is due to zookeeper timeout to the brokers. The broker znodes are removed in zookeeper but the brokers are available for producing and consuming. To solve the issue, increase the zookeeper client session timeout to a reasonable value. CM doesn't alert about the znodes not available in zookeeper. This alerting seems to be available from CM 5.14.x
... View more
05-04-2018
04:04 AM
2 Kudos
Just select "None" in Sentry service section of Kafka. You don't have to delete rules. The rules are stored in sentry and since kafka will not ask, rules are useless.
... View more
04-12-2018
01:22 AM
@denole Yes, i agree with your point. my notion of this was to test when we have quickstart VM for testing.
... View more
03-09-2018
06:26 AM
2 Kudos
What is the meaning of having kafka-sentry, when you don't have kerberos enabled? For the moment, Kerberos is the only authentication engine supported by Kafka. When you don't have Kerberos enabled, all connection are treated the same. As you can see from the log, it thinks that the username is ANONYMOUS, that's why it tries to find the group that this user belongs to. Since, the local system is not aware of any user (either local or synced to an LDAP/AD) with the name "ANONYMOUS", there is no group retrieved, so it cannot be matched to any kafka-sentry rule. It is normal that it will fail. Of course, you can create a user account "ANONYMOUS", assign it to a group and define a kafka-sentry rule with this group. But what is the meaning to that? All connections will have the same permissions.
... View more
02-21-2018
01:18 AM
Hi @awong That means we would need a java or such program to convert the data to Parquet and then copy to HDFS right!!
... View more
- « Previous
-
- 1
- 2
- Next »