Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Is the DistCp NameNode path the active HDFS NameNode or the active ResourceManager?

avatar
Rising Star

When specifying fully-qualified paths to copy data between two HA clusters with DistCp, e.g:

hdfs://nn1:8020/foo/bar

Is the address of nn1 really referring to the where the active HDFS NameNode is, or is it looking for the active ResourceManager?

Thanks!

1 ACCEPTED SOLUTION

avatar
Master Guru

It refers to active Name Node. For distcp you are providing 2 paths, source and target files/directories, both on HDFS of respective clusters. With some more settings you can refer to NN name service, meaning that you don't need to care which NN is active.

View solution in original post

1 REPLY 1

avatar
Master Guru

It refers to active Name Node. For distcp you are providing 2 paths, source and target files/directories, both on HDFS of respective clusters. With some more settings you can refer to NN name service, meaning that you don't need to care which NN is active.