Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Connecting to AWS S3 from NiFi

avatar
Super Collaborator

Hi,

i am trying to connect to an AWS S3 bucket which i was given access to.

I got uid,pwd and a key from the owners. But in ListS3 processor i dont see those fields.

i see Access Key and Secret Key properties. Is Access key and password are same ? We dont have to put in a user name.? also is Region a must.?

do i need to specify just the bucket name for ex vendor-company-bucket or do i have to fully specify the URL like https://vendor-company-bucket.s3-us-west-2.amazonaws.com?

43829-lists3.jpg

Regards,

Sai

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
7 REPLIES 7

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Super Collaborator
@Saikrishna Tarapareddy

You don't use username and pswd, you need access key and secret key. Admin of the S3 account can generate it (refer to https://aws.amazon.com/blogs/security/wheres-my-secret-access-key/)

Region and bucket are mandatory and you can see that when you access your S3 via web:

42927-s3-1.png

under "Services" menu go to "Storage->S3":

42926-s3-2.png

avatar

I am facing different issue, I gave all the details you mentioned but i am its giving me an error unable to execute HTTP request. Note i used proxy also to connect but still unable to execute

@SumanP

avatar
Rising Star

I am facing connectivity issue from Apache Nifi to Amazon SQS & S3:

I have given the details in the below link:

https://community.hortonworks.com/questions/214811/connection-issue-in-integrating-apache-nifi-with-...

Thanks in Advance.

Please suggest.

avatar

Hi,
I m trying to put files into AWS S3 browser from Nifi using PutS3Object processor and getting below error.
Bucket Name ,  AccessKeyID and SecretAccessKey are used correctly.

I m stuck here. Please help.


avatar
Community Manager

@Naveen_Sagar, Welcome to Cloudera Community! As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.



Regards,

Vidya Sargur,
Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar

 Sure Vidya

Thanks.!