How to perform TPCH on Hive?

mmlr_90 — Sat, 11 Feb 2017 10:46:58 GMT

Good evening, im trying to perform a TPC-H benchmark on hive, i donloaded from .git hive-testbench (https://github.com/hortonworks/hive-testbench) after i build (./tpch-build.sh) i try to generate the data (./tpch-setup.sh 10),

but ir gives error saying that dbgen.jar doenst exist (but he exists):~

ls: `/tmp/tpch-generate/10/lineitem': No such file or directory Generating data at scale factor 10. Exception in thread "main" java.io.FileNotFoundException: File file:/home/centos/hive-testbench-hive14/tpch-gen/target/lib/dbgen.jar does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:598) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:811) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:588) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:425) at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:340) at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:2042) at org.notmysock.tpch.GenTable.copyJar(GenTable.java:163) at org.notmysock.tpch.GenTable.run(GenTable.java:100) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.notmysock.tpch.GenTable.main(GenTable.java:54) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

ls: `/tmp/tpch-generate/10/lineitem': No such file or directory

I already tried to generate sepecifying a directory but the result its the same. Can you give me some kind of help?

Re: How to perform TPCH on Hive?

sunile_manjee — Sat, 11 Feb 2017 11:31:18 GMT

The dbgen.jar was not created during build. please verify you have gcc installed.

Re: How to perform TPCH on Hive?

mmlr_90 — Tue, 14 Feb 2017 07:55:32 GMT

I was able to generate the data (10GB), but now that i've runned some queries, i get no results except on Query 1 that returns 4 rows.

When i run the queries on hive command line it gives me the output of the mapreduce jobs, but in the end it doesnt return any rows.

Can you give me some kind of help?

question How to perform TPCH on Hive? in Archives of Support Questions (Read Only)

How to perform TPCH on Hive?

Re: How to perform TPCH on Hive?

Re: How to perform TPCH on Hive?