Support Questions

Find answers, ask questions, and share your expertise

Hadoop arquive error

New Contributor

Hi!,

When executing the command: "hadoop archive -Dmapred.job.queue.name = default -archiveName <filename> .har -p <input_hdfs_dir> <output_hdfs_dir>" I am getting the following error in the Map Reduce job

14687-hadoop-error.png

1 REPLY 1

Guru

@Márcio Vieira, This application is failing while fetching shuffle data from other node. It is likely that nodes are not able to fetch result from remote nodes. Can you please check if your cluster has firewall enabled or having issues with DNS resolution?

Refer to below links.

http://stackoverflow.com/questions/10729543/shuffle-errorexceeded-max-failed-unique-matche-bailing-o...

http://stackoverflow.com/questions/30352446/hadoop-mapreduce-shuffle-error-exceeded-max-failed-uniqu...

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.