Support Questions

Find answers, ask questions, and share your expertise

Flowfiles are stuck in que/connection of Nifi

avatar
Master Collaborator

Hi,

I have a kafka consumer, that is consuming messages after that flowfiles are not moving at all.

Suddenly this issue started.

many messages are stuck at diff connection/queue in btw processors even though processor running it is not getting processing

dataflow-struck.png

Thanks,

Mahendra

1 ACCEPTED SOLUTION

avatar

@Mahendra Hegde

In the snapshot you attached, all the processors are stopped. Start all your processors and also verify the following metrics.

1. Is your processor running on all the nodes? Sometimes it may happen that you have your flow files on "Not Primary Node" and the downstream processor is running only in the Primary Node, which sometimes results in such behavior.

2. If #1 does not hold true and all your processors are running "correctly" on all nodes or whatever the correct configuration is, please verify that how many threads are running for your processor(s).

3. Please check your JVM usage for NiFi. Verify if it is "too" high for whatever reason.

4. Please check the scheduling of your processors.

Let know if you are able to see anything "unusual" from the above basic debugging steps.

Hope that helps!

View solution in original post

3 REPLIES 3

avatar

@Mahendra Hegde

In the snapshot you attached, all the processors are stopped. Start all your processors and also verify the following metrics.

1. Is your processor running on all the nodes? Sometimes it may happen that you have your flow files on "Not Primary Node" and the downstream processor is running only in the Primary Node, which sometimes results in such behavior.

2. If #1 does not hold true and all your processors are running "correctly" on all nodes or whatever the correct configuration is, please verify that how many threads are running for your processor(s).

3. Please check your JVM usage for NiFi. Verify if it is "too" high for whatever reason.

4. Please check the scheduling of your processors.

Let know if you are able to see anything "unusual" from the above basic debugging steps.

Hope that helps!

avatar
Master Collaborator

Thanks for replies,

Issue was due to concurrent thread configuration.

When we increase the max allowed thread count in controller settings, issue solved.

We stopped all flows, increased the count, restarted the node and then flows.

avatar
New Contributor

Scrabble game is word finder game which is you increase your number and word knowledge. Because its have base of number and words.Then friends boost your knowledge and game skill.