Support Questions

Find answers, ask questions, and share your expertise

Benchmarking/perf test cluster after adding new hardware

New Contributor

We are updating some older hardware in our cluster, and are looking for a good way to benchmark performance before and after the hardware updates. Are there any other tools that people have used other than hadoop-mapreduce-client-jobclient-tests.jar to validate performance on newer hardware?


@George Thomas

Your question too generic, you haven't mentioned for which component you want to do benchmarking.

For mapreduce - you can use the hadoop-mapreduce-client-jobclient-tests.jar

For hive benchmarking - You could use the following github code.

For hbase:-

you could use the default hbase pe utility.

time hbase org.apache.hadoop.hbase.PerformanceEvaluation -nomapred randomWrite 10

or utility like "ycsb"

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.