Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Monitoring Nifi Throughput apart from UI any logs or best practices?

avatar
Expert Contributor

Is there any way to monitor the throughput of Nifi i.e. how many messages it has processed in a second? Apart from Nifi UI and Ambari is there a way to monitor the throughput for Nifi please like logs as i cant find any detials regarding throughput in nifi logs or in any of the nifi repositories(content, flowfile,db) as well?

1 ACCEPTED SOLUTION

avatar
Master Guru

The NiFi UI has a Summary page from the top-right menu, as well as stats on each processor by right-clicking and selecting Status History. Both of those views show things like bytes read/written, flow files in/out, etc.

If you want to track this information somewhere else, you can implement a custom ReportingTask to send this information somewhere. This is how Ambari is able to display the stats/graphs, there is an AmbariReportingTask:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-ambari-bundle/nifi-ambari-reporting...

View solution in original post

1 REPLY 1

avatar
Master Guru

The NiFi UI has a Summary page from the top-right menu, as well as stats on each processor by right-clicking and selecting Status History. Both of those views show things like bytes read/written, flow files in/out, etc.

If you want to track this information somewhere else, you can implement a custom ReportingTask to send this information somewhere. This is how Ambari is able to display the stats/graphs, there is an AmbariReportingTask:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-ambari-bundle/nifi-ambari-reporting...