Support Questions

Find answers, ask questions, and share your expertise

Hadoop arquive error

New Contributor

Hi!,

When executing the command: "hadoop archive -Dmapred.job.queue.name = default -archiveName <filename> .har -p <input_hdfs_dir> <output_hdfs_dir>" I am getting the following error in the Map Reduce job

14687-hadoop-error.png

1 REPLY 1

Guru

@Márcio Vieira, This application is failing while fetching shuffle data from other node. It is likely that nodes are not able to fetch result from remote nodes. Can you please check if your cluster has firewall enabled or having issues with DNS resolution?

Refer to below links.

http://stackoverflow.com/questions/10729543/shuffle-errorexceeded-max-failed-unique-matche-bailing-o...

http://stackoverflow.com/questions/30352446/hadoop-mapreduce-shuffle-error-exceeded-max-failed-uniqu...