Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

getting error while executing distcp

getting error while executing distcp

Contributor

kindly find the attatched file with detailed errors which i am getting while using distcp from one ambari slave to another ambari slave of another cluster.

distcp-logs.txt

8 REPLIES 8

Re: getting error while executing distcp

@hardik desai

Are the DN's functioning properly ? Can you check if the datanodes are in exclude list ?

Suspected from below error from logs -

There are 3 datanode(s) running and 3 node(s) are excluded in this operation.

Re: getting error while executing distcp

Try to check the "dfs.hosts.exclude" property of your "hdfs-site.xml" file.

Re: getting error while executing distcp

Contributor
@Sagar Shimpi

I will check for the same. tahnks for the update.

Re: getting error while executing distcp

Contributor

@Sagar Shimpi i have checked the property & it has the value= /etc/hadoop/conf/dfs.exclude. when i checked the file from the slave node , it is an empty file.Nothing inside it.

Highlighted

Re: getting error while executing distcp

@hardik desai

Can you check the contents from the file from namenode machine ?

$cat /etc/hadoop/conf/dfs.exclude.

Re: getting error while executing distcp

Contributor

@Sagar Shimpi the file is blank and no data into it.

Re: getting error while executing distcp

Can you make sure port[50010] are open?

Chcek if you are able to connect to 50010, try writing some sample data to remote cluster from existing node.

Re: getting error while executing distcp

New Contributor

@hardik desai, you may turn on debug log in the namenode for

 org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy

so that it will print more information in the namenode log on why the datanodes are excluded.

Don't have an account?
Coming from Hortonworks? Activate your account here