question Re: Delete/Stop flow files in execute script in Archives of Support Questions (Read Only)

Delete/Stop flow files in execute script

rameshtec1991 — Sun, 18 Aug 2019 07:54:14 GMT

Hi Team,

I want to either delete or stop the flow files which didn't satisfy the condition in execute script.

I'm getting lot of flow files into my execute script processor out of which didn't satisfy the condition needs to be stopped/deleted at the execute script processor it self and whichever the flow files satisfy the condition needs to move to the next step. Can we stop/delete the flow files in execute script processor.

Below is the logic inside the execute script.

Re: Delete/Stop flow files in execute script

Wynner — Sat, 17 Mar 2018 01:08:51 GMT

@Pavan M

It might be easier to stop/delete the flow files before they get to the ExecuteScript processor using the RouteText processor.

Re: Delete/Stop flow files in execute script

RahulSoni — Sun, 18 Aug 2019 07:54:06 GMT

@Pavan M You can use the remove method from the session object. Follows an example.

NiFi Flow

Each GenerateFlowFile processor generate an empty flow with an attributed called "a" valued 1, 2 & 3 respectively.

Script in ExecuteScript processor

flowFile = session.get() 
a = int(flowFile.getAttribute('a')) 

if(a == 1): 
 session.transfer(flowFile, REL_FAILURE) 
elif(a == 2): 
 session.transfer(flowFile, REL_SUCCESS) 
else: 
 session.remove(flowFile)

So the flowFiles with "a" equalling 1 or 2 are being redirected accordingly while the others are removed. You can see that SUCCESS and FAILURE relation have 1 flow file each. The third one has been deleted.

You can modify the above script according to your business logic and you should be good.

Hope that helps!

Thanks!

Re: Delete/Stop flow files in execute script

Shu_ashu — Sun, 18 Aug 2019 07:53:58 GMT

@Pavan M

As you are not transferring any of the flowfiles to REL_FAILURE, Transfer the else flowfiles to failure relation and auto terminate the failure relation,

else:
session.transfer(flowFile, REL_FAILURE)

Auto terminate failure relation

(or)

You can use session.remove to remove the flowfile

else:
session.remove(flowFile)

by using any of the above ways you can achieve same result as you are expecting.