Support Questions
Find answers, ask questions, and share your expertise

MapReduce fails with benchmarking

Solved Go to solution
Highlighted

MapReduce fails with benchmarking

Rising Star

I'm currently running benchmarks on a newly installed HDP cluster, running HDP 2.4. I have run the following benchmarks so far:

TestDFSIO

Teragen/Terasort/Teravalidate

MRBench

These all give me essentially the same error:

Diagnostics: ExitCodeException exitCode=2:

gzip: /foo/bar/yarn/local/filecache/14_tmp/tmp_mapreduce.tar.gz: unexpected end of file

tar: This does not look like a tar archive

tar: Exiting with failure status due to previous errors

I assume that the mapreduce jar is copied into a temp folder for the job. The original mapreduce jar is a valid tar, and I have extracted it with 7zip showing it has all the expected contents.

Has anybody seen this error before? Any guidance on how I might go about solving it?

Thanks in advance.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: MapReduce fails with benchmarking

Mentor

I would review the mapreduce section in the manual installation guide, i always refer to it even if i use automated install http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/configur...

View solution in original post

2 REPLIES 2
Highlighted

Re: MapReduce fails with benchmarking

Mentor

I would review the mapreduce section in the manual installation guide, i always refer to it even if i use automated install http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/configur...

View solution in original post

Highlighted

Re: MapReduce fails with benchmarking

Rising Star

That was the issue, thank you. The local version of the tarball was fine, but the one in DFS had zero size. Uploading the local version gets my MapReduce working as expected.