Skip to main content
MKothari
Gold ⭐️
April 17, 2023
Solved

NIFI 1.18.0 is not cleaning flow file from queue

HI ,

Hi,
I was using NIFI 1.12.0 version and now shiting a job into NIFI 1.18.0 version because of some security concerns. I am facing challenges in that the NIFI queue is not getting empty after successfully data transfer to EventHub. Below is the NIFI 

MKothari_0-1681721262917.png

 

MKothari
MKothariAnswer
Gold ⭐️
April 24, 2023

There was some issue with PublishKafka_2.6.After changing to PublishKafka_2.0 problem got resolved.

6 replies

VidyaSargur
Community Manager
Community Manager
April 18, 2023

@MKothari, Welcome to our community! To help you get the best possible answer, I have tagged in our NiFi experts @cotopaul @SAMSAL @steven-matison @ckumar @MattWho  who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

Translate
Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
MKothari
MKothariAuthor
Gold ⭐️
April 18, 2023

Thanks Viidya

Translate
cotopaul
Platinum ⭐️
April 18, 2023

hi @MKothari,

Are you certain that your messages get transferred successfully? Based on your screenshot, I can see that no FlowFile got IN in the past 5 mins, meaning that your flow is not running, even though everything is green and you have no errors in your GUI.
I assume that the flowfile format matches whatever you have configured in your kafka. Have a look within PublishKafka and see if you do not have a strange scheduling set, causing you to see the number increasing instead of decreasing. Another thing you might try is stop both EvaluateJsonPath and PublishKafka and right click on your matched queue and open List Queue and see if there are any flowfile there and if so, on which node. Next, you can go on that node and further check the log file for possible error messages.

Translate
MKothari
MKothariAuthor
Gold ⭐️
April 19, 2023

Thanks ....let me validate the proposed one and update

Translate