Reply
New Contributor
Posts: 4
Registered: ‎04-24-2019

fails to send data from horotnworks to cloudera cluster using distcp command?

I am trying to send simple small file from hortonworks to cloudera cluster using distcp command but failed. Getting error

'"could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation."

Did several attempts to get rid off this but not succeeded yet.Please do suggest me the solution.
Thanks in advance.

Cloudera Employee
Posts: 818
Registered: ‎03-23-2015

Re: fails to send data from horotnworks to cloudera cluster using distcp command?

Hi Muhammad,

The error looks like that either the source or destination cluster has no DataNodes running. Have you confirmed if that was the case? Check the DN logs to see what might have happened. Or maybe add more nodes, as 1 node cluster is single point of failure.

Cheers
Eric
New Contributor
Posts: 4
Registered: ‎04-24-2019

Re: fails to send data from horotnworks to cloudera cluster using distcp command?

Thanks for the reply.

Actually i can send data from cloudera to hortonworks but not in reverse direction.Other than that i can list hdfs directories(of hortonworks cluster) on cloudera and vice versa but failed to copy data from hortonworks to cloudera.

I'm still looking for the solution.

Highlighted
Cloudera Employee
Posts: 818
Registered: ‎03-23-2015

Re: fails to send data from horotnworks to cloudera cluster using distcp command?

Hi Muhammad,

Since the error mentioned that you only have one DN and it is excluded in the operation, which means you have no live DNs.

Have you checked what happened to the DN? Any indications on it logs?

Cheers
Eric