Migrating data from HDP to AWS

[#1]

Hi All,

We are migrating the data from local on primise server to aws.

Can any one please tell me what are the ports need to be open in order to communicate with AWS S3 and can do the distcp

It's kerberos(local HDP) to un kerberos( AWS)

Thanks.

[#2 · Accepted solution]

Hi @raghavendra v,

Did you set the following configuration properties to authenticate with S3? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-config-prop...

If copying from HDFS in a cluster on prem to S3, this is the setting that you need.

[#3]

@Dominika Bialek Thanks for the info.