- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Flowfile is currently penalized and data cannot be processed at this time . How to solve this issue ?
- Labels:
-
Apache NiFi
Created ‎01-11-2024 01:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am facing below issue in my flow..
flowfile is currently penalized and data cannot be processed at this time .
Any idea how to solve this issue .
Thanks in advance .
Created on ‎01-12-2024 06:09 AM - edited ‎01-12-2024 07:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Madhav_VD
What about the "Relationship" tab?
My guess here is that you have checked the "retry" box on the success relationship of the putSQL processor. If that is the case, unchecking "retry" on the success relationship should resolve your FlowFile penalization issue:
When this processor is running, does it produce any bulletins or exceptions in the log output? If it is producing bulletins, warn, or error logs, it is likely failing to write to your SQL DB. The FlowFIle would then be routed to retry or failure relationship depending on exception where "retry" if checked would be applied based on retry property configurations.
If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
Thank you,
Matt
Created ‎01-11-2024 02:09 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Madhav_VD
How has yoru PutSQL processor been configured (all tabs)?
For a FlowFile(s) to be penalized a processor needs to apply that penalty.
That could be applied by the PutSQL if you configure retry on a relationship or being applied by the processor feeding the connection. Looking at your attached dataflow, I don't believe the EvaluateJsonPath processor is applying any such penalty.
If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
Thank you,
Matt
Created ‎01-11-2024 09:51 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi this is how i have configured my PutSQL processor . Let me know if i missed or need to Change any configuration.
Created on ‎01-12-2024 06:09 AM - edited ‎01-12-2024 07:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Madhav_VD
What about the "Relationship" tab?
My guess here is that you have checked the "retry" box on the success relationship of the putSQL processor. If that is the case, unchecking "retry" on the success relationship should resolve your FlowFile penalization issue:
When this processor is running, does it produce any bulletins or exceptions in the log output? If it is producing bulletins, warn, or error logs, it is likely failing to write to your SQL DB. The FlowFIle would then be routed to retry or failure relationship depending on exception where "retry" if checked would be applied based on retry property configurations.
If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
Thank you,
Matt
Created ‎10-24-2024 12:26 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
In PutSql Processor, there is a property "Support Fragmented Transactions". If set its value to be false, then it is proceeding and not penalising the flow files.
Created ‎10-24-2024 12:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
In PutSql Processor, there is a property "Support Fragmented Transactions". If I set its value to be false, then it is proceeding and not penalising the flow files.
