Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

I am a new user in hadoop system, i want to benchmarking on hdfs and get latency value, but i am confused how to do it. Can anyone help, please? Thanks.

I am a new user in hadoop system, i want to benchmarking on hdfs and get latency value, but i am confused how to do it. Can anyone help, please? Thanks.

New Contributor
 
2 REPLIES 2

Re: I am a new user in hadoop system, i want to benchmarking on hdfs and get latency value, but i am confused how to do it. Can anyone help, please? Thanks.

Expert Contributor
@Irfan syafii

- Take a look at the Ambari Metrics to understand some of the core cluster metrics. Current versions of HDP have Grafana Dashboards to give more detail.

- There a number of benchmark options:

https://gist.github.com/ace-subido/0a9b219b2348921f6a87

https://github.com/hortonworks/hive-testbench

TESTDFSIO being a good option to get an understanding of read/write performance (lots of articles on that).

The second link relates to Hive and TPC type benchmarks.

- For more advanced users, there is also SmartSense with HDP, which can make recommendations on performance issues.

Regards,

Highlighted

Re: I am a new user in hadoop system, i want to benchmarking on hdfs and get latency value, but i am confused how to do it. Can anyone help, please? Thanks.

New Contributor

Thanks for your response @Graham Martin, but i am still confused how to get the latency value of the hdfs benchmarking test. By the way, can i get the latency value of HDFS by doing benchmarking test?

Don't have an account?
Coming from Hortonworks? Activate your account here