question Re: Extracttext processor multiple record handling in Support Questions

Extracttext processor multiple record handling

Chakkara — Sat, 22 May 2021 19:05:38 GMT

I am trying to load data from the below input to db.

My input is as shown below

i, John, $100

ii, Kevin, $150

iii, Steve, $200

Created getfile, ReplaceAttributes, Extracttext, Route to attributes, putsql flow

I have managed to parse fixed width file records and replaced with comma delimited values. ExtractText processor with Enable Multiline Mode=true, Enable DOTALL Mode=true. After execution I see below in provenance event in attributes tab

line i

line.0 John

line.1 $100

Please advise how to load other two records which was not getting displayed in the attributes.

Re: Extracttext processor multiple record handling

MattWho — Mon, 24 May 2021 13:24:42 GMT

@Chakkara

The more detail you can provide, the better we may be able to assist.

Are you using custom processors? NiFi does not come with a ReplaceAttribute processor.

I am assuming your flow may actually be using:
GetFile (deprecated processor in favor of the listFile and FetchFile processors) --> UpdateAttribute --> ExtractText --> RouteOnAttribute --> putSQL

Can you share the configuration you are currently using on the above processors, so we can see what you are doing now? Perhaps you only need a few tweaks to your current design.

Thanks,

Matt

Re: Extracttext processor multiple record handling

TimothySpann — Mon, 24 May 2021 18:56:46 GMT

Some examples

https://community.cloudera.com/t5/Support-Questions/How-Extract-text-from-a-multiline-flow-and-create-only-one/td-p/104706

https://nathanlabadie.com/recombining-multiline-logs-with/

https://github.com/tspannhw/EverythingApacheNiFi/blob/main/README.md