Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Benchmarking/perf test cluster after adding new hardware

Highlighted

Benchmarking/perf test cluster after adding new hardware

New Contributor

We are updating some older hardware in our cluster, and are looking for a good way to benchmark performance before and after the hardware updates. Are there any other tools that people have used other than hadoop-mapreduce-client-jobclient-tests.jar to validate performance on newer hardware?

1 REPLY 1

Re: Benchmarking/perf test cluster after adding new hardware

Contributor
@George Thomas

Your question too generic, you haven't mentioned for which component you want to do benchmarking.

For mapreduce - you can use the hadoop-mapreduce-client-jobclient-tests.jar

For hive benchmarking - You could use the following github code.

https://github.com/hortonworks/hive-testbench/tree/hdp26

For hbase:-

you could use the default hbase pe utility.

time hbase org.apache.hadoop.hbase.PerformanceEvaluation -nomapred randomWrite 10

or utility like "ycsb"