I am working on Hadoop framework/technologies with Hive, Ambari, Ranger and planning to create a dashboard, which provides following information :
-Execution time of a Hive query.
-Size of data generated by the created table.
-Frequency of using each hive schema, table and each column of respective table.
-User/ Application name or ID firing any query
-Resources usage of each application /User.
For now, I am trying to use HiveMetastore and Ranger audit logs to access the above mentioned information.
Is there any other better way to fetch the information above ?
Kindly let me know, if I need to provide any more information.