Support Questions

Find answers, ask questions, and share your expertise

Migrating data from HDP to AWS

avatar
Contributor

Hi All,

We are migrating the data from local on primise server to aws.

Can any one please tell me what are the ports need to be open in order to communicate with AWS S3 and can do the distcp

It's kerberos(local HDP) to un kerberos( AWS)

Thanks.

1 ACCEPTED SOLUTION

avatar

Hi @raghavendra v,

Did you set the following configuration properties to authenticate with S3? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-config-prop...

If copying from HDFS in a cluster on prem to S3, this is the setting that you need.

View solution in original post

2 REPLIES 2

avatar

Hi @raghavendra v,

Did you set the following configuration properties to authenticate with S3? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-config-prop...

If copying from HDFS in a cluster on prem to S3, this is the setting that you need.

avatar
Contributor

@Dominika Bialek Thanks for the info.