Member since
04-11-2023
14
Posts
8
Kudos Received
0
Solutions
01-09-2026
01:42 PM
Hello @MattWho thanks for the information. I'm already running the process only on the Primary node. I will monitor and take a thread dump if it occurs again.
... View more
01-09-2026
07:41 AM
@vafs I'm using version 1.23.2. I'm already using Tracking Timestamps within ListS3.
... View more
01-08-2026
11:51 AM
Hello Matt, The files were just sitting in the S3 bucket. It appears that ListS3 process just didn't response. After checking the ListS3 state no entry listed for the files at that time. I had to stop the ListS3 process then start it before it pickup the files. No error indicated that there as an issue with ListS3, no alert within the log for this ListS3 processor. What is the exact version of Apache NiFi being used? 1.23.2 Single NiFi instance or a multi-node NiFi cluster setup? 3 Nodes Clusters How many "running" processors on your canvas? 2103 How large is the NiFi Max Timer Driven Thread pool set to (default is 10, but typically this is set to 2 to 4 times the number of cores on the NiFi host). 10 Monitoring of CPU load average with your flow running will allow you to determine if you can increase this even more. Okay f you saw a small number displayed on the processor indicating it was scheduled to execute while it as not producing any FlowFiles, you could take a serious of thread dumps which you could inspect to see if the listS3 processor thread was making any progress or just blocked/waiting. Not seeing this at the moment. Regards
... View more
01-06-2026
08:53 AM
Hello all, I have an ListS3 process that access an S3 bucket to pickup files. This process running fine since deployed in October 2025. Today, noticed that the files didn't get pickup and they were no error reported on the ListS3. The state didn't list the current files in S3 waiting to pickup. I had to stop and start the process before it get pickup. I enabled debug to see if it will report any issue while trying to connect and also updated the run scheduled from 0 to 5 seconds. Any other suggestion or recommendation on what I can do to be prepare to help identify the issue if it occurred again in the future? Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
09-24-2025
12:44 PM
Hello all, I'm currently running Nifi 1.23.2 in a 3 nodes cluster. I would received the following message when I tried to login. I would get kick out then this message will appear. I verified I have sticky session enabled on SSLSession. Its also configured in round robin DNS. Is there anything else I can look at thats contributing to this issue? Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
10-18-2024
12:57 PM
1 Kudo
Hello Matt, Thanks for the information. With the flow.json.gz if a process group get deleted then the entire fflow.json.gz need to be restore. I was wondering if there is another way to backup the running progress groups without taking a complete template backup that I can backup that will list the individual process groups so I can choose the one that's require a restore instead of restore all the process groups. Thanks!
... View more
10-18-2024
07:47 AM
Hello All, I'm running a Nifi cluster with 3 nodes. Below are some questions in regards to backup. 1. What's the best way to backup Nifi without stop \ starting? 2. Is there a way to backup all the processes running using a backup method in the event I need to restore 1 process I don't have to restore all the processes available? Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
03-29-2024
08:15 AM
1 Kudo
Hello Matt, Its configured via UDP, I understood that there is no way to track data loss. Is there anything I can check from Nifi that may contribute to this issue ? For example if systems resource are high or other factor. Thanks!
... View more
03-28-2024
07:08 PM
3 Kudos
Hello, I'm currently running Nifi version 1.8.0, starting from last week I noticed that I'm missing PutSysLog message from my syslog system. Some logs would appear and some wouldn't write to the syslog system. I checked my syslog system and was unable to find any issue. No other systems are experiencing issue writing to the syslog system. I enabled DEBUG on PutSysLog and it shows it was successful in sending the message to the syslog system but no entry exists. At the same time other PutSysLog does record the entries in syslog system and the file flows through other processors. Any suggestions on how to troubleshoot this issue? Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
04-27-2023
07:51 AM
Hello @MattWho @SAMSAL @steven-matison @DigitalPlumber @cotopaul , after confirming the access I'm able to verified I can access the bucket from aws cli on the same system Nifi is running on and download files. The problem I'm having now is that the ListS3 pickup the list of the files from the bucket but the FetchS3 doesn't do anything. When I enabled debugging on the FetchS3 I receiving the following error message. FetchS3 Error message FetchS3 Configuration ListS3 Configuration Any suggestion to what is causing the issue?
... View more