fs.s3n.awsSecretAccessKey property not being accepted

battlesysadmin — Fri, 16 Sep 2022 09:18:59 GMT

on: Cloudera Manager 4.8.4

I set the fs.s3n.awsSecretAccessKey property in the core-site.xml through the HDFS safety valve, and still can't run the job. Running the job gives me this error:

java.lang.IllegalArgumentException: AWS Secret Access Key must be specified as the password of a s3n URL, or by setting the fs.s3n.awsSecretAccessKey property.

Meanwhile, I can run the job with the same credentials on a different cluster. Everything I've read says once you add these credentials, deploy the config and restart the cluster, you're good to go.

I've also tried adding the property to the hdfs-site.xml and I've compared the jar file on both clusters to make sure they md5sum the same.

Anyone run into some issues with their AWS credentials?

Re: fs.s3n.awsSecretAccessKey property not being accepted

battlesysadmin — Wed, 14 Jan 2015 19:03:16 GMT

Found my answer, and wanted to share....

The override must go into the MapReduce Gateway client config safety valve.

Thanks, everyone.

Re: fs.s3n.awsSecretAccessKey property not being accepted

battlesysadmin — Wed, 14 Jan 2015 19:05:21 GMT

... in the mapred-site.xml

question Re: fs.s3n.awsSecretAccessKey property not being accepted in Archives of Support Questions (Read Only)

fs.s3n.awsSecretAccessKey property not being accepted

Re: fs.s3n.awsSecretAccessKey property not being accepted

Re: fs.s3n.awsSecretAccessKey property not being accepted