Support Questions

Find answers, ask questions, and share your expertise

Migrating data from HDP to AWS

Contributor

Hi All,

We are migrating the data from local on primise server to aws.

Can any one please tell me what are the ports need to be open in order to communicate with AWS S3 and can do the distcp

It's kerberos(local HDP) to un kerberos( AWS)

Thanks.

1 ACCEPTED SOLUTION

Hi @raghavendra v,

Did you set the following configuration properties to authenticate with S3? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-config-prop...

If copying from HDFS in a cluster on prem to S3, this is the setting that you need.

View solution in original post

2 REPLIES 2

Hi @raghavendra v,

Did you set the following configuration properties to authenticate with S3? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-config-prop...

If copying from HDFS in a cluster on prem to S3, this is the setting that you need.

Contributor

@Dominika Bialek Thanks for the info.