Dears ,   I have a question for the best practices should be done on cloudera cluster specially on hdfs level using sentry RBACS.the main concern for us is that the data is copied from external resources to hdfs and the permissions make headache for us as sentry cannot be applied on URI level.Si there any solutions or document for such cases to follow?   Regards ... View more

Hi ,   I have kafka cluster managed by CDH 6.3 built on 3 servers acting as brokers and zookeepers, i have enabled kerberos on the clustser but after that i am not able to start it wit the following error on all brokers:   4:29:50.269 AM WARN ClientCnxn SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/var/run/cloudera-scm-agent/process/4531-kafka-KAFKA_BROKER/jaas.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. 4:29:50.269 AM INFO ClientCnxn Opening socket connection to server xxxxx.xxxx:2181 4:29:50.269 AM ERROR ZooKeeperClient [ZooKeeperClient] Auth failed. 4:29:50.270 AM WARN ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1224) 4:29:50.844 AM INFO ZooKeeperClient [ZooKeeperClient] Closing. 4:29:51.370 AM WARN ClientCnxn SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/var/run/cloudera-scm-agent/process/4531-kafka-KAFKA_BROKER/jaas.conf'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. 4:29:51.371 AM INFO ClientCnxn Opening socket connection to server jxxxx.xxx:2181 4:29:51.371 AM ERROR ZooKeeperClient [ZooKeeperClient] Auth failed. 4:29:51.473 AM INFO ZooKeeper Session: 0x0 closed 4:29:51.473 AM INFO ClientCnxn EventThread shut down 4:29:51.475 AM INFO ZooKeeperClient [ZooKeeperClient] Closed. 4:29:51.477 AM ERROR KafkaServer Fatal error during KafkaServer startup. Prepare to shutdown kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply$mcV$sp(ZooKeeperClient.scala:242) at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:238) at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:238) at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:251) at kafka.zookeeper.ZooKeeperClient.kafka$zookeeper$ZooKeeperClient$$waitUntilConnected(ZooKeeperClient.scala:238) at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:96) at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1824) at kafka.server.KafkaServer.kafka$server$KafkaServer$$createZkClient$1(KafkaServer.scala:361) at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:385) at kafka.server.KafkaServer.startup(KafkaServer.scala:205) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:42) at kafka.Kafka$.main(Kafka.scala:75) at com.cloudera.kafka.wrap.Kafka$$anonfun$1.apply(Kafka.scala:92) at com.cloudera.kafka.wrap.Kafka$$anonfun$1.apply(Kafka.scala:92) at com.cloudera.kafka.wrap.Kafka$.runMain(Kafka.scala:103) at com.cloudera.kafka.wrap.Kafka$.main(Kafka.scala:95) at com.cloudera.kafka.wrap.Kafka.main(Kafka.scala) 4:29:51.478 AM INFO KafkaServer shutting down 4:29:51.481 AM INFO KafkaServer shut down completed 4:29:51.481 AM ERROR KafkaServerStartable Exiting Kafka.   Noting that in the path /var/run/cloudera-scm/process/broker and zookeeper i can find the keytabs and jaas files and i can make kinit successfully. What causing this ? and what should i do or re configure???   ... View more