- Take a look at the Ambari Metrics to understand some of the core cluster metrics. Current versions of HDP have Grafana Dashboards to give more detail.
- There a number of benchmark options:
TESTDFSIO being a good option to get an understanding of read/write performance (lots of articles on that).
The second link relates to Hive and TPC type benchmarks.
- For more advanced users, there is also SmartSense with HDP, which can make recommendations on performance issues.
Thanks for your response @Graham Martin, but i am still confused how to get the latency value of the hdfs benchmarking test. By the way, can i get the latency value of HDFS by doing benchmarking test?