Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error in PutS3Object

Solved Go to solution
Highlighted

Error in PutS3Object

I encounter a strange behavior when uploading files to S3 using PutS3Object process. It raises the following error:

ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.aws.s3.PutS3Object PutS3Object[id=12b0e9ff-0159-1000-ffff-ffffeedc377a] Error checking S3 Multipart Upload list for graphdb-poc-rawdata/: Key is not expected for the GET method ?uploads subresource (Service: Amazon S3; Status Code: 400; Error Code: InvalidRequest; Request ID: AC706A3B0F7DF2B9)

But, the strange thing is that despite of this error I do see that files are actually uploaded to S3 bucket. Is there anything wrong with what I'm doing? I'll appreciate any suggestion how to fix this.

10499-2016-12-19-14-05-27.jpg

Thank you!

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Error in PutS3Object

We decided to leave it as its because this was for a PoC and anyway, files in S3 were created properly.

View solution in original post

10 REPLIES 10
Highlighted

Re: Error in PutS3Object

Can you please share your 1. S3 Bucket policy 2. Cors configuration. 3. NiFI processor config. You can check https://community.hortonworks.com/articles/49467/integrating-apache-nifi-with-aws-s3-and-sqs.html for reference.

Highlighted

Re: Error in PutS3Object

Expert Contributor

you may be missing something in the s3 policy. Looks like the code is trying to read the data after uploading and then failing. May you should give permissions to read what is being uploaded to the bucket.

Highlighted

Re: Error in PutS3Object

Thank you! I will check with AWS admin

Highlighted

Re: Error in PutS3Object

@Michael Kalika,

I am facing the same issue. Can I know how we remediated this issue even though file is created without any issues in AWS S3.

Highlighted

Re: Error in PutS3Object

Did you ever figure this out? We are expereincing the same error even with extra perms added to the user for the bucket we are getting errors for

Highlighted

Re: Error in PutS3Object

We decided to leave it as its because this was for a PoC and anyway, files in S3 were created properly.

View solution in original post

Highlighted

Re: Error in PutS3Object

We were getting same issue and it was because our PutS3Object had directory information in the Bucket field and just the filename in the Object Key field. We changed it so that the Bucket itself was the only thing in the Bucket field and all the directory and filename information was in the Object Key field.

Re: Error in PutS3Object

@Simon Engelbert

Thanks. Its perfectly working. Nice work.

Highlighted

Re: Error in PutS3Object

New Contributor

Thank you. Worked perfect!!

Don't have an account?
Coming from Hortonworks? Activate your account here