How to perform TPC-DS test/workloads on impala,hive and spark?

[#1]

Hi Team,

How to perform TPC-DS test/workloads on hive,impala,spark? how to analyze the results? 

Thanks,

Harish

[#2 · Accepted solution]

Hi @Harish19 , the best place for information regarding TCP-DS tests on Impala would be (follow the README.md):

https://github.com/cloudera/impala-tpcds-kit

Once the data is populated in HDFS and tables are created, you likely can run most the same queries in tree/master/queries/ on Hive and/or Hive on Spark to test.

IBM and Databricks have githubs with some SparkSQL tests, which you can Google for, but I have not personally evaluated them, or know if they work.

Thanks,