Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

java.io.IOException: Cannot find AWS access key.

avatar
Contributor

I've a Spark job copying file from S3 bucket to HDFS using spark data frame api.

if we change --executor-cores to 1. then the job is successfully completing without any issues. if we change --executor-cores to 5 then it is throwing below error.

java.io.IOException: Cannot find AWS access key.

at org.apache.hadoop.fs.s3a.S3AFileSystem.getAWSAccessKeys(S3AFileSystem.java:358)

1 ACCEPTED SOLUTION

avatar
Expert Contributor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
1 REPLY 1

avatar
Expert Contributor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login