bench-marking and performance matrix test cases

[#1]

Hi I need to run some bench marking that will provide optimal performance for Write I/O, Read I/O CPU utilization, Memory Utilization. Is there any benchmarking suite available for hortonworks that I can use or If someone has any matrix to what and how to test that would be a great help.

[#2]

@Syed Naqvi

See this

Hive ...use this

You have to run your own benchmarks based on your cluster. If you run google search then you can find more data on benchmarks done by different users.

[#3 · Accepted solution]

@Syed Naqvi for HBase benchmarking, take a look at YCSB, there's benchmark tool Yahoo built for Streaming Engines benchmark as well. For purely hardware benchmarks, use DD test for disk, memtop for Memory, top for CPU and here's a way to do it for network, just posted today.

[#4]

All suggestions above are good. Adding article on tools to use to benchmark the hardware. https://community.hortonworks.com/content/kbentry/56158/benchmark-your-hardware-for-hadoop-spark.htm...