New Contributor
Posts: 2
Registered: ‎06-06-2016

Spark Program throwing error

Hi ,


We have enabled KMS in our server, after enabling KMS and encryption , we are getting following error randomly , Is there anything we can try to resolve this issue ?


org.apache.spark.SparkException: Job aborted due to stage failure: Task 58 in stage 12.0 failed 4 times, most recent failure: Lost task 58.3 in stage 12.0 (TID 4151, lpdn0307.): java.lang.IllegalArgumentException: edhpen1262 at org.apache.hadoop.crypto.key.kms.KMSClientProvider.createConnection( at org.apache.hadoop.crypto.key.kms.KMSClientProvider.decryptEncryptedKey( at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider$ at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider$ at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider.doOp( at org.apache.hadoop.crypto.key.kms.LoadBalancingKMSClientProvider.decryptEncryptedKey( at org.apache.hadoop.crypto.key.KeyProviderCryptoExtension.decryptEncryptedKey( at org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey( at org.apache.hadoop.hdfs.DFSClient.createWrappedInputStream(


We verified the DNS resolution and hostname , everything is looking good.


What else may be the issue.



Vishnu Ravi

Cloudera Employee
Posts: 25
Registered: ‎01-27-2017

Re: Spark Program throwing error



Can you provide what versions of CDH/CM you are currently running? Have any other services/componets been impacted after enabling KMS?