@Jean-François Vandemoortele The workaround is to add "-- conf spark.hadoop.fs.hdfs.impl.disable.cache=true" to Spark job command line parameters to disable the token cache from spark side. Please let me know it that worked out for you . ... View more

@Jean-François Vandemoortele You will need to create a jaas.conf and pass it like in the below example java -Djava.security.auth.login.config=/home/hdfs-user/jaas.conf \ -Djava.security.krb5.conf=/etc/krb5.conf \ -Djavax.security.auth.useSubjectCredsOnly=false \ -cp "./hdfs-sample-1.0-SNAPSHOT.jar:/usr/hdp/current/hadoop-client/lib/*:/usr/hdp/current/hadoop-hdfs-client/*:/usr/hdp/current/hadoop-client/*" \ hdfs.sample.HdfsMain Contents of the jaas.conf should look like this ---start of jaas.conf------- com.sun.security.jgss.krb5.initiate { com.sun.security.auth.module.Krb5LoginModule required doNotPrompt=true principal="hdfs-user@YOUR_REALM" useKeyTab=true keyTab="/path/to/hdfs-user.keytab" storeKey=true; }; ---End of jaas.conf------- Now your jobs will run successfully by renewing the Kerberos tickets. ... View more

@ASIF Khan Unfortunately you went the wrong road. Troubleshooting such an orthodox implementation becomes a nightmare, it advisable to use standard management tool like Ambari when implementing HDP clusters. Folks here could easily guide you and locate the config files easily and hence help out. ... View more

@Andres Urrego How much memory have you allocated the Sandbox? What is the network config you have chosen. ... View more

@Sundara Palanki You should enable the Ranger Kafka hook,restart all stale configs and retry ... View more

@Sam Red Unfortunately, you will have to use the classic way 🙂 depending on your OS adapt appropriate commands as root, below example is on centos6 # useradd user15 # passwd user15 And repeat that on all the hosts in the cluster, from the Ambari server if you created a passwordless ssh then it's easier! # ssh root@host5 [root@host5 ~]# useradd user15 [root@host5 ~]# passwd user15 Tedious work ..... if you have a cluster with 100 nodes! ... View more