question Re: Error in PutS3Object in Support Questions

Error in PutS3Object

michael_kalika — Sun, 18 Aug 2019 11:40:53 GMT

I encounter a strange behavior when uploading files to S3 using PutS3Object process. It raises the following error:

ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.aws.s3.PutS3Object PutS3Object[id=12b0e9ff-0159-1000-ffff-ffffeedc377a] Error checking S3 Multipart Upload list for graphdb-poc-rawdata/: Key is not expected for the GET method ?uploads subresource (Service: Amazon S3; Status Code: 400; Error Code: InvalidRequest; Request ID: AC706A3B0F7DF2B9)

But, the strange thing is that despite of this error I do see that files are actually uploaded to S3 bucket. Is there anything wrong with what I'm doing? I'll appreciate any suggestion how to fix this.

Thank you!

Re: Error in PutS3Object

mpandit — Mon, 19 Dec 2016 22:54:54 GMT

Can you please share your 1. S3 Bucket policy 2. Cors configuration. 3. NiFI processor config. You can check https://community.hortonworks.com/articles/49467/integrating-apache-nifi-with-aws-s3-and-sqs.html for reference.

Re: Error in PutS3Object

knarayanan — Mon, 19 Dec 2016 23:00:16 GMT

you may be missing something in the s3 policy. Looks like the code is trying to read the data after uploading and then failing. May you should give permissions to read what is being uploaded to the bucket.

Re: Error in PutS3Object

michael_kalika — Mon, 19 Dec 2016 23:49:00 GMT

Thank you! I will check with AWS admin

Re: Error in PutS3Object

simon_engelbert — Fri, 10 Feb 2017 01:56:51 GMT

Did you ever figure this out? We are expereincing the same error even with extra perms added to the user for the bucket we are getting errors for

Re: Error in PutS3Object

gowthaman1992 — Thu, 23 Mar 2017 22:51:23 GMT

@Michael Kalika,

I am facing the same issue. Can I know how we remediated this issue even though file is created without any issues in AWS S3.

Re: Error in PutS3Object

michael_kalika — Fri, 24 Mar 2017 02:51:33 GMT

We decided to leave it as its because this was for a PoC and anyway, files in S3 were created properly.

Re: Error in PutS3Object

simon_engelbert — Fri, 24 Mar 2017 03:05:00 GMT

We were getting same issue and it was because our PutS3Object had directory information in the Bucket field and just the filename in the Object Key field. We changed it so that the Bucket itself was the only thing in the Bucket field and all the directory and filename information was in the Object Key field.

Re: Error in PutS3Object

gowthaman1992 — Wed, 29 Mar 2017 16:49:20 GMT

@Simon Engelbert

Thanks. Its perfectly working. Nice work.

Re: Error in PutS3Object

aksroopa — Sat, 21 Apr 2018 02:19:29 GMT

Thank you. Worked perfect!!

Re: Error in PutS3Object

gabrielfqueiroz — Tue, 28 May 2019 02:34:30 GMT

Thanks! No more errors!!

Re: Error in PutS3Object

JoaquinC — Mon, 31 Aug 2020 20:38:24 GMT

This worked for me. Thanks.

Re: Error in PutS3Object

Raquel_BB — Wed, 04 Nov 2020 09:03:50 GMT

Thanks! it worked for me

Re: Error in PutS3Object

SamarApple — Fri, 19 Apr 2024 22:46:48 GMT

I am still seeing the same error, despite having just Bucket Name in Bucket and file path in ObjectKey. Anything i was missing?

Re: Error in PutS3Object

DianaTorres — Sat, 20 Apr 2024 00:49:45 GMT

@SamarApple Hello! As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks.