Member since
06-01-2023
2
Posts
0
Kudos Received
0
Solutions
06-01-2023
08:18 AM
HI Diana, I couldn't find a label for Hadoop, this question relates to Hadoop specifically.
... View more
06-01-2023
06:50 AM
I am using a library that internally uses the hadoop-aws module and uses IAM Assumed Roles to connect to S3. However, the documentation mentions the following: The S3A connector supports assumed roles for authentication with AWS.
A full set of login credentials must be provided,
which will be used to obtain the assumed role and refresh it regularly. Now, to configure the authentication mechanism, there is property fs.s3a.assumed.role.credentials.provider with a few possible values, but all of the values are based on top of credentials like AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY etc. However, AWS recommends to use IAM Roles instead of access keys. Is there a way to configure this S3 adapter using IAM Roles so that I do not need to define the access keys?
... View more
Labels:
- Labels:
-
Apache Hive