Support Questions

Find answers, ask questions, and share your expertise

I am a new user in hadoop system, i want to benchmarking on hdfs and get latency value, but i am confused how to do it. Can anyone help, please? Thanks.

New Contributor

Expert Contributor
@Irfan syafii

- Take a look at the Ambari Metrics to understand some of the core cluster metrics. Current versions of HDP have Grafana Dashboards to give more detail.

- There a number of benchmark options:

TESTDFSIO being a good option to get an understanding of read/write performance (lots of articles on that).

The second link relates to Hive and TPC type benchmarks.

- For more advanced users, there is also SmartSense with HDP, which can make recommendations on performance issues.


New Contributor

Thanks for your response @Graham Martin, but i am still confused how to get the latency value of the hdfs benchmarking test. By the way, can i get the latency value of HDFS by doing benchmarking test?