question Re: bench-marking and performance matrix test cases in Archives of Support Questions (Read Only)

bench-marking and performance matrix test cases

syedjamalnaqvi — Tue, 02 Feb 2016 05:12:42 GMT

Hi I need to run some bench marking that will provide optimal performance for Write I/O, Read I/O CPU utilization, Memory Utilization. Is there any benchmarking suite available for hortonworks that I can use or If someone has any matrix to what and how to test that would be a great help.

Re: bench-marking and performance matrix test cases

nsabharwal — Tue, 02 Feb 2016 05:37:55 GMT

@Syed Naqvi

See this

Hive ...use this

You have to run your own benchmarks based on your cluster. If you run google search then you can find more data on benchmarks done by different users.

Re: bench-marking and performance matrix test cases

aervits — Tue, 02 Feb 2016 05:38:00 GMT

@Syed Naqvi for HBase benchmarking, take a look at YCSB, there's benchmark tool Yahoo built for Streaming Engines benchmark as well. For purely hardware benchmarks, use DD test for disk, memtop for Memory, top for CPU and here's a way to do it for network, just posted today.

Re: bench-marking and performance matrix test cases

sunile_manjee — Wed, 01 Mar 2017 05:22:51 GMT

All suggestions above are good. Adding article on tools to use to benchmark the hardware. https://community.hortonworks.com/content/kbentry/56158/benchmark-your-hardware-for-hadoop-spark.html