Member since
10-19-2021
3
Posts
0
Kudos Received
0
Solutions
10-22-2021
07:41 PM
Thanks Matt, It is very helpful
... View more
10-19-2021
09:49 AM
Description: Nifi node will be stuck and all processors won't deal with flow file when one processor is processing a large flow file, like PutFile, ExecuteStreamCommand, ConvertRecord. Nifi node will be very very slow and heavy cpu usage. Sometime the cpu usage rate will over 700%. Then the heartbeat may be Disconnected. Heavy cpu usage also can cause other processors stuck and never consume any flow file until the large flow file processing is completed. As I know, the PutFile or ExecuteStreamCommand shouldn't cost too many cpu, it is just executing a cp command in linux. We have tried to increase the total thread count. But it is not any effect. This issue happened after we upgrade the nifi version from 1.8 to 1.12. We can't understand why these processors can cost so many cpu than nifi node will be disconnected from cluster. Anyone can help me? Thanks a lot. Nifi Version: 1.12 Machine capacity: cpu 8 core, memory 64G, Xmx 20G, Nifi node amount 5
... View more
Labels:
- Labels:
-
Apache NiFi