Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

fails to send data from horotnworks to cloudera cluster using distcp command?

fails to send data from horotnworks to cloudera cluster using distcp command?

I am trying to send simple small file from hortonworks to cloudera cluster using distcp command but failed. Getting error

'"could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation."

Did several attempts to get rid off this but not succeeded yet.Please do suggest me the solution.
Thanks in advance.

3 REPLIES 3

Re: fails to send data from horotnworks to cloudera cluster using distcp command?

Guru
Hi Muhammad,

The error looks like that either the source or destination cluster has no DataNodes running. Have you confirmed if that was the case? Check the DN logs to see what might have happened. Or maybe add more nodes, as 1 node cluster is single point of failure.

Cheers
Eric
Highlighted

Re: fails to send data from horotnworks to cloudera cluster using distcp command?

Thanks for the reply.

Actually i can send data from cloudera to hortonworks but not in reverse direction.Other than that i can list hdfs directories(of hortonworks cluster) on cloudera and vice versa but failed to copy data from hortonworks to cloudera.

I'm still looking for the solution.

Re: fails to send data from horotnworks to cloudera cluster using distcp command?

Guru
Hi Muhammad,

Since the error mentioned that you only have one DN and it is excluded in the operation, which means you have no live DNs.

Have you checked what happened to the DN? Any indications on it logs?

Cheers
Eric