question Actions of long running Spark streaming job fails with "HDFS_DELEGATION_TOKEN token can't be found in cache" in Support Questions

question Actions of long running Spark streaming job fails with "HDFS_DELEGATION_TOKEN token can't be found in cache" in Support Questions https://community.cloudera.com/t5/Support-Questions/Actions-of-long-running-Spark-streaming-job-fails-with-quot/m-p/287927#M213331 We are running a production spark streaming job on a Kerberised CDH cluster and some of its actions fails less than 4 days with the following error condition:<LI-CODE lang="markup">org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): token (HDFS_DELEGATION_TOKEN token <token_id> for <user>) can't be found in cache</LI-CODE> Spark submission script already contains the following settings:<LI-CODE lang="markup">--conf spark.yarn.principal=<principal> --conf spark.yarn.keytab=<keytab_location_on_disk> --conf spark.hadoop.fs.hdfs.impl.disable.cache=true</LI-CODE> Spark version is 1.6.0-CDH5.11.1OS is RHEL 6.9 Do anybody have further suggestions about configuration or where to look for futher information about this issue?  Sun, 19 Jan 2020 19:17:48 GMT IsmailKeskin 2020-01-19T19:17:48Z