Support Questions

Find answers, ask questions, and share your expertise

Spark Program throwing error

New Contributor

Hi ,


We have enabled KMS in our server, after enabling KMS and encryption , we are getting following error randomly , Is there anything we can try to resolve this issue ?


org.apache.spark.SparkException: Job aborted due to stage failure: Task 58 in stage 12.0 failed 4 times, most recent failure: Lost task 58.3 in stage 12.0 (TID 4151, lpdn0307.): java.lang.IllegalArgumentException: edhpen1262 at org.apache.hadoop.crypto.key.kms.KMSClientProvider.createConnection( at org.apache.hadoop.crypto.key.kms.KMSClientProvider.decryptEncryptedKey( at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider$ at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider$ at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider.doOp( at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider.decryptEncryptedKey( at org.apache.hadoop.crypto.key.KeyProviderCryptoExtension.decryptEncryptedKey( at org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey( at org.apache.hadoop.hdfs.DFSClient.createWrappedInputStream(


We verified the DNS resolution and hostname , everything is looking good.


What else may be the issue.



Vishnu Ravi





Can you provide what versions of CDH/CM you are currently running? Have any other services/componets been impacted after enabling KMS? 




New Contributor

Did anyone found the solution for this issue? I have a similar issue, We are using CM5.11 and installed Spark2 seperately on other server. When we enable KMS on the cluster then Spark2 throws Unknown Host exception.