Member since
05-30-2023
45
Posts
4
Kudos Received
0
Solutions
10-23-2025
10:59 AM
@MattWho No, no WARNINGS OR ERROR in the log files. I dont see any out of memory issues as well. However, I have gotten the diagnostics file and I am attaching it in the reply. Can you please look at it and give me any clue to further diagnose this queuing issue?
... View more
10-23-2025
07:20 AM
@MattWho I tried to increase the thread count but the issue still persists. I was able to locate one queued file in the logs and I am pasting it under: this particular flowfile got queued and never processed despite having 30 minutes gone. Its merely a 1.4kb file.
... View more
10-08-2025
10:37 AM
Thanks for replying @MattWho. Yes, Max Timer Driven Thread pool is set to 10 by default. At one time, around 10+ processors run in a single proccess group. Moreover, the Flowfile is indefinitely queued until I manually stop the next processor and then start it again. Once I start it, it smoothly migrates the data. I have not checked the logs, I will do so now.
... View more
10-08-2025
07:55 AM
Hi all, I have been seeing this problem increasingly now that the data gets stuck in between two different processors -- the data being as small as few KBs what could be the cause of it? The ExecuteSQL contains an SQL insert script. Moreover, this behavior is random -- occurs randomly on any processor. Does my machine specs count in this? I see my CPU usage and memory are not choking as well. Any comments on this will be appreciated. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
10-17-2024
10:39 AM
1 Kudo
" The only error from today seem to be repeating: 2024-10-17 08:35:19,764 ERROR [Timer-Driven Process Thread-5] o.a.n.c.s.StandardControllerServiceNode StandardControllerServiceNode[service=CSVRecordLookupService[id=a8b84b00-b0ee-31c8-dbda-7e7e9795ba4b], name=CSVRecordLookupService, active=true] Encountering difficulty enabling. (Validation State is INVALID: ['CSV File' is invalid because CSV File is required, 'Lookup Key Column' is invalid because Lookup Key Column is required]). Will continue trying to enable. 2024-10-17 08:35:19,764 ERROR [Timer-Driven Process Thread-13] o.a.n.c.s.StandardControllerServiceNode StandardControllerServiceNode[service=CSVRecordLookupService[id=10c1880b-0376-3223-c6b8-8d14780a8001], name=CSVRecordLookupService, active=true] Encountering difficulty enabling. (Validation State is INVALID: ['CSV File' is invalid because CSV File is required, 'Lookup Key Column' is invalid because Lookup Key Column is required]). Will continue trying to enable." I am also having these erros, if it helps you in any way.
... View more
10-17-2024
10:35 AM
The NiFi actually starts for the first time, if I close it and try to restart it, it never gets restarted again. No custom add ons. I dont know how to debug in logback.
... View more
10-17-2024
08:49 AM
@MattWho Hi Matt, I am having the same issue as: Here are my web properties: and java version as below: Please suggest any resolution.
... View more
10-02-2023
10:12 AM
Thats right. I intend to convert the json using JoltTransfomationRecord into csv format and then save the file in my local machine.
... View more
10-02-2023
09:40 AM
@SAMSAL thank you for responding. I am infact using/converting the output from ExecuteSql from Arvo to Json using ConvertAvroToJson processor. Below is the output of the same processor: I am also wondering if I am providing the json format, its throwing error for avro. Can you suggest something?
... View more