Cluster usage and evolution

[#1]

Hi, we are looking for the best way (tips and tricks) to follow up the cluster usage. In a data lake with multiple project running on the same cluster, we want to identify the hdfs usage evolution per project (hive, hbase, ...). And the same we want to get an overview of whom did used how much of the cluster resources.

Thanks for the info.

Wim

[#2 · Accepted solution]

With the release of Smartsense 1.3 you're able to get that information from your cluster using tools like Ambari Metrics Service and prebuilt Zepplin notebooks.