Member since
05-22-2018
9
Posts
1
Kudos Received
0
Solutions
08-14-2019
12:26 PM
I should have said that this was using the embedded option for the coordinator. I managed to find the solution by way of an old mailinglist thread (from 2016) [1] that suggested starting the nodes at the same time, rather than one after the other. The reason is that if you start up one node, it will go into a connection frenzy failing to contact the other nodes, quickly hitting the connection limit (and leaving lots of dangling connections in "close wait" state). [1] http://apache-nifi.1125220.n5.nabble.com/Zookeeper-error-td13355.html
... View more
05-29-2018
01:00 PM
@Dilip Namdev The 409 conflict response from NiFi is typical when the service is not available to serve the request. In a NiFi cluster you requests must be replicated to the other node(s). It may be possible that those replication requests failed. It may also be possible that you had a node disconnected. - You should inspect the nifi-user and nifi-app logs at around the time of these failed rest-api calls to see what state you NiFi was in or if there was an issue with a replication request. - Thank you, Matt
... View more
05-22-2018
04:02 PM
1 Kudo
@Dilip Namdev
The fact that every "archive" sub-directory is empty leads me to believe that archive is in fact working correctly. NiFi stores FlowFile content in claims within the content repository. One claim may contain 1 to many Flowfiles. All it takes is one FlowFile to still be active in one of your dataflows (queued in some NiFi connection) to hold up an entire content claim. A content claim cannot be moved to archive unless all active flowfiles referencing that claim are complete (meaning reached a point of termination in your dataflow). - The following article explains this in more detail: https://community.hortonworks.com/articles/82308/understanding-how-nifis-content-repository-archivi.html - Aside from the above, NiFi opens a lot of file handles. Having insufficient file handles can cause issues with creation of new files. This may affect proper cleanup of both the flowfile and content repositories. I suggest making sure the user that owns your NiFi process has a high number of open file handles available to it. - Thanks, Matt - If you found this answer addressed your question, please take moment to login and click "accept" below the answer
... View more
05-22-2018
03:51 PM
@Dilip Namdev The number of templates you have created will have no impact on NiFi UI performance. When you instantiate a template to the canvas it is merely building a flow like any other flow you would construct. - When it comes to UI performance/responsiveness, a good first place to start is with how many NiFi components you have on your canvas and what state they are currently in. The following article should help you there: https://community.hortonworks.com/articles/184786/hdfnifi-improving-the-performance-of-your-ui.html - Thanks, Matt - If you found this answer addressed your question, please take moment to login and click "accept" below the answer.
... View more