nifi hdf 3.1.0 ListS3 processor AWS wont accept access_id Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId

[#1]

Hi, 

I try to connect to my s3 bucket with ListS3 processor as shown on the picture

I got my credentials from the credentials file

λ cat credentials

[default]

aws_access_key_id = xxxxxx

aws_secret_access_key = xxxxxx

aws_session_token = FQoGZXIvYXdzEBoxxxxxxxx

But it i got this error

sktq1ehdf1nn01.ccta.dk:9091ListS3[id=288c3ee5-0168-1000-ffff-ffffe596788e] ListS3[id=288c3ee5-0168-1000-ffff-ffffe596788e] failed to process due to com.amazonaws.services.s3.model.AmazonS3Exception: The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: 05B234720FA788D4), S3 Extended Request ID: g0d8XYmhVRcP+HLuVUEEFREd486cVPQD+h1DL7RTG5KSoU3HGAlFJU0cVBP1RATyjprjRgSp5aI=; rolling back session: The AWS Access Key Id you provided does not exist in our records. (Service: Amazon S3; Status Code: 403; Error Code: InvalidAccessKeyId; Request ID: 05B234720FA788D4)

Then tried maunally renew my keys by

aws configure at set a fresh pair of crdentials in my ListS3 processor but with same errors.

I seems like the ACCESS_KEY property in ListS3 is not the same as the value aws_access_key_id from the

credentials file

[#2]

Hi Simon,

I am facing the same issue but my case might be different.

Are you using temporary credentials? i.e. assuming role. If so, you can't provide aws_session_token property in nifi unfortunately and this will throw the error you are facing.

There is an open issue here
https://issues.apache.org/jira/browse/NIFI-7900 

/Mahmoud