Skip to main content
netin
Gold ⭐️
April 9, 2024
Solved

Hang NiFi threads on 1.13.2.RC1

Hello.

I'm using 1.13.2.RC1 and recently i started to notice something, it suddenly stops to process all the flows and hangs the active threads by not giving any response anymore.

There's no error in the log, as the time passes, it's only showing a bunch of Minimal Locking Write Ahead Log, and nothing more than this.

As long i do not restart, it keeps as it is infinitely, until i restart and everything starts to work once again.

Can somebody please give me a light to what's happening?

Screenshot_2024-04-09_16-28-26.png

In this print, there's a process group and in there, a bunch of Query Database Table and some other processors, and it's hang.

Example of hang Query Database Table:Screenshot_2024-04-09_16-32-31.png

Once i restart, the infinite active thread quits.

 

Important info:

Maximum timer driven thread count: 20

Maximum event driven thread count: 5

Connection Pool 1.13.2: Max Connection Pool: 15.

 

The database itself is working properly and fine.

 

Thank you in advance.

netin
netinAnswer
Gold ⭐️
May 8, 2024

Everybody, just updating the issue, my problema "kinda" got fixed after adjusting configuration on NiFi.

 

nifi.content.repository.archive.max.usage.percentage=50%

Set to 90% and reduced the amount of times NiFi freezes.

 

https://issues.apache.org/jira/browse/NIFI-8726 

4 replies

DianaTorres
Community Manager
Community Manager
April 9, 2024

@netin Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @MattWho @SAMSAL  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Translate
Regards, Diana Torres, Senior Community Moderator
netin
netinAuthor
Gold ⭐️
April 10, 2024

Thank you Diana Torres.

Another thing i noticed when debugging the Flow Engine:

if (task.isDone()) {
if (task.isCancelled()) {
if (logger.isDebugEnabled()) {
logger.debug("A flow controller execution task '{}' has been cancelled.", runnable);
}
} else {
task.get(); //to raise any exceptions that might have occurred.
logger.debug("A Flow Controller execution task '{}' has completed.", runnable);
}
}

The task is never done when the NiFi behaves in the described situation, so i restarted and the task pass the isDone condition.

I don't now if it is relevant or not, but anyway i will still be debugging it, if i find something else i found interesting, i post here again.

Thank you.

Translate
DianaTorres
Community Manager
Community Manager
April 17, 2024

@steven-matison @mburgess Hi! Do you have any insights here by chance? Thanks!

Translate
Regards, Diana Torres, Senior Community Moderator
netin
netinAuthorAnswer
Gold ⭐️
May 8, 2024

Everybody, just updating the issue, my problema "kinda" got fixed after adjusting configuration on NiFi.

 

nifi.content.repository.archive.max.usage.percentage=50%

Set to 90% and reduced the amount of times NiFi freezes.

 

https://issues.apache.org/jira/browse/NIFI-8726 

Translate