Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

MapReduce fails with benchmarking

avatar
Expert Contributor

I'm currently running benchmarks on a newly installed HDP cluster, running HDP 2.4. I have run the following benchmarks so far:

TestDFSIO

Teragen/Terasort/Teravalidate

MRBench

These all give me essentially the same error:

Diagnostics: ExitCodeException exitCode=2:

gzip: /foo/bar/yarn/local/filecache/14_tmp/tmp_mapreduce.tar.gz: unexpected end of file

tar: This does not look like a tar archive

tar: Exiting with failure status due to previous errors

I assume that the mapreduce jar is copied into a temp folder for the job. The original mapreduce jar is a valid tar, and I have extracted it with 7zip showing it has all the expected contents.

Has anybody seen this error before? Any guidance on how I might go about solving it?

Thanks in advance.

1 ACCEPTED SOLUTION

avatar
Master Mentor

I would review the mapreduce section in the manual installation guide, i always refer to it even if i use automated install http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/configur...

View solution in original post

2 REPLIES 2

avatar
Master Mentor

I would review the mapreduce section in the manual installation guide, i always refer to it even if i use automated install http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/configur...

avatar
Expert Contributor

That was the issue, thank you. The local version of the tarball was fine, but the one in DFS had zero size. Uploading the local version gets my MapReduce working as expected.