How to configure multiple S3 end-points in a multi-tenanted cluster?

[#1]

I have a multi-tenanted HDP2.3 cluster. It has been configured with an S3 end-point in custom hdfs-site.xml. Is it possible to add another S3 end-point for another tenant? If so, what should be the property name?

Thanks in Advance.

[#2]

Hi @Phoncy Joseph In HDP 2.6.1 you can set per-bucket properties to authenticate with multiple buckets. See https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-auth-per-bu....

However, I believe that this was introduced in HDP 2.5 or 2.6 so it is most likely not available in HDP 2.3.

CC @stevel

[#3]

I have using HDP 2.5 but when i configured multiple buckets after that doing LS it throwing access denied error 403.

[#4]

@Phoncy Joseph To add to the previous answer:

If you upgrade to HDP 2.6.1, there is a new Ranger feature that allows you to control access to S3 buckets via Hive by different user. It's a new "URL" parameter available when creating a Hive policy: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_security/content/hive_policy.html.

So once you add multiple S3 buckets you can control which user can read or write from which buckets.