Increase spark.kryoserializer.buffer.max property value value according to the required size , by default it is 64 MB.    Got same Exception, ran job by increasing the value and was able to run it properly. ... View more

Sentry-HDFS authorization is focused on Hive warehouse data - that is, any data that is part of a table in Hive or Impala.    For HDFS-only control, you should looke at HDFS ACLs or Extended ACLs.   See this doc. ... View more

i , did you find a solution for that , i have the same request by audit team. ... View more

Thank you for your reply , I followed cloudera's documentation to configure kafkas kerberos , From Cloudera Manager, navigate to Kafka > Configurations. Set SSL client authentication to none. Set Inter Broker Protocol to SASL_PLAINTEXT. on each broker : Kafka Broker Advanced Configuration Snippet (Safety Valve) for kafka.properties: listeners=SASL_PLAINTEXT://broker1FQDN:9093 advertised.listeners=SASL_PLAINTEXT://broker1FQDN:9093   on zookeeper config: check the option : Enable Kerberos Authentication check the option : Enable Server to Server SASL Authentication the errors on ZK side are the following : ZooKeeper-2 ZooKeeper Canary Suppress... Server (broker1FQDN) Quorum Membership Suppress... Server (broker1FQDN) Quorum Membership Suppress... Server (broker3FQDN) Quorum Membership and in the log: java.io.IOException: Could not configure server because SASL configuration did not allow the ZooKeeper server to authenticate itself properly: javax.security.auth.login.LoginException: Clock skew too great (37) at org.apache.zookeeper.server.ServerCnxnFactory.configureSaslLogin(ServerCnxnFactory.java:211) at org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:82) at org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:137) at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:118) at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:81) 2020-04-27 11:48:57,528 INFO org.apache.zookeeper.server.quorum.QuorumPeerConfig: Reading configuration from: /var/run/cloudera-scm-agent/process/4648-zookeeper-server/zoo.cfg 2020-04-27 11:48:57,540 INFO org.apache.zookeeper.server.quorum.QuorumPeerConfig: Defaulting to majority quorums 2020-04-27 11:48:57,544 INFO org.apache.zookeeper.server.DatadirCleanupManager: autopurge.snapRetainCount set to 5 2020-04-27 11:48:57,544 INFO org.apache.zookeeper.server.DatadirCleanupManager: autopurge.purgeInterval set to 24 2020-04-27 11:48:57,544 INFO org.apache.zookeeper.server.DatadirCleanupManager: Purge task started. 2020-04-27 11:48:57,552 INFO org.apache.zookeeper.server.DatadirCleanupManager: Purge task completed. 2020-04-27 11:48:57,556 INFO org.apache.zookeeper.server.quorum.QuorumPeerMain: Starting quorum peer 2020-04-27 12:27:59,649 ERROR org.apache.zookeeper.server.quorum.QuorumPeerMain: Unexpected exception, exiting abnormally   please help.   ... View more

Hello Friend , ow can i add the kafka-handler.jar  in cloudera cluster?? from the manager or i have to copy the jar t specific location? can you explain ... View more

Hello ,  I have question , i have cloudera cluster how to configure this kafka-handler within the cluster in order to integrate with hiv e , spark , and the other services in the cluster? is there special configuration from cloudera manager ?? ... View more