Can we dist cp multiple directories from one cluster to other server in one go?

[#1]

I need to distcp hdfs://nn1:port/foo/bar/2016/* and

hdfs://nn1:port/foo/bar/2017/* into

hdfs://nn2:port/foo/bar/2016/* and

hdfs://nn2:port/foo/bar/2017/* in one go..How can we achieve that? If I use distcp

hdfs://nn1:port/foo/bar/2016/

\

hdfs://nn1:port/foo/bar/2017

hdfs://nn2:port/foo/bar/ then underlying directoris i.e. 2016 and 2017 are not getting created. I need distcp to create these directories and copy data.

[#2 · Accepted solution]

1. Below command works, i tried it. It also creates folders 2016 and 2017

hadoop distcp hdfs://nn1:port/foo/bar/2016 hdfs://nn1:port/foo/bar/2017 hdfs://nn2:port/foo/bar

2. If not working can you try this (Actually both are same)

hadoop distcp -f hdfs://nn1:port/srclist hdfs://nn2:port/foo/bar

Where srclist has

hdfs://nn1:port/foo/bar/2016
hdfs://nn1:port/foo/bar/2017