Member since
08-19-2024
15
Posts
8
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1029 | 08-22-2024 12:41 AM |
10-24-2024
12:26 AM
In PutSql Processor, there is a property "Support Fragmented Transactions". If set its value to be false, then it is proceeding and not penalising the flow files.
... View more
09-09-2024
01:07 PM
@AlokKumar The more detail you provide the better response you will get. In this case, more detail around the content/format of the source file (samples are great) and how it is being or will be processed downstream. A NiFi FlowFile is what is passed from one processor component to the next. There is no direct relationship between what processing was done in one processor versus another. Each Processor will read the FlowFile (consists of FlowFile Attributes/metadata and FlowFile content) and execute its processor code against the FlowFile and output a FlowFile(s) to one or more outbound relationships. So processing against the content of A FlowFile becomes the responsibility of each processor separately. So the questions asked correlate to the answer you'll get. With what you shared, I can only suggest that you remove the first line from the content of the FlowFile so that downstream processor will only have line 2 to process against. This can be accomplished easily with a ReplaceText processor. Simply configure it for "Evaluation Mode" = "line-by-line", "line-by-line Evaluation Mode" = "First-Line", and in "Replacement Value" property "Set empty string" check box. The output FlowFile' content, which is sent to the success relationship, will have everything except its first line. Do you need to preserve line 1? If so, maybe use ExtractText to extract line 1 to a FlowFile attribute you can then use after processing to add back to Content again using ReplaceText. Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
09-04-2024
02:51 PM
@AlokKumar I am not able to understand the context here. It would help to get to right solution if you can explain why the inserts into same table should be executed in certain order. However, Nifi Connection configuration settings have prioritizers. Please check screenshot below.. If you are able to set attribute "priority" with desired number, "PriorityAttributePrioritizer" can be used. Please note that these prioritizers operate on node level. You may have to test these if you have multi node nifi environment. There is a processor "EnforceOrder" which has more options to enforce execution order. You may check this processor and find out if it works. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/nifi2.0-m4/org.apache.nifi.processors.standard.EnforceOrder/index.html
... View more
09-03-2024
11:09 PM
2 Kudos
Thanks, it was ReplaceText processor and this regex really helped
... View more
08-28-2024
08:32 AM
hello, one stackoverflow answer suggested to configure property "Record Reader"-> "Csv Reader". Property of Controller Service (Csv Reader), "Schema Access Strategy" to be "Use String Fields from header". This helped. You are telling about Avro Schema. Could you please give some insights. How to configure that? Also I have one more different topic question. Say I have a file having 100 records. In this file I want to ignore the first line as it's data I do not want to process. I want to process from second line. How to do that? Thanks
... View more
08-22-2024
12:42 AM
1 Kudo
Thanks @VidyaSargur Also I have replied which seems to be solution (property Support Framgmented Transactions as false in PutSql Processor) which seems to be helping.
... View more