Support Questions

Find answers, ask questions, and share your expertise

Is the DistCp NameNode path the active HDFS NameNode or the active ResourceManager?

avatar
Rising Star

When specifying fully-qualified paths to copy data between two HA clusters with DistCp, e.g:

hdfs://nn1:8020/foo/bar

Is the address of nn1 really referring to the where the active HDFS NameNode is, or is it looking for the active ResourceManager?

Thanks!

1 ACCEPTED SOLUTION

avatar
Master Guru

It refers to active Name Node. For distcp you are providing 2 paths, source and target files/directories, both on HDFS of respective clusters. With some more settings you can refer to NN name service, meaning that you don't need to care which NN is active.

View solution in original post

1 REPLY 1

avatar
Master Guru

It refers to active Name Node. For distcp you are providing 2 paths, source and target files/directories, both on HDFS of respective clusters. With some more settings you can refer to NN name service, meaning that you don't need to care which NN is active.