Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Generate multiple FlowFiles with ExecuteScript

Solved Go to solution
Highlighted

Generate multiple FlowFiles with ExecuteScript

New Contributor

Hello,

I'm trying to generate multiple FlowFIles out of one input (using ExecuteScript with Jython), because I need to split a "Comment"-Entry into multiple information.
Currently I'm tryining to send out each flowfile in a for-loop with this Statement

for i in iterTyreFinder:    
    ....SomeMagic    
    flowFile2 = session.write(flowFile, PyOutputStreamCallback())
    session.transfer(flowFile2, REL_SUCCESS)

Where the OutputStreamCallback only writes the text of an variable out

# Define a subclass of OutputStreamCallback for use in session.write()
class PyOutputStreamCallback(OutputStreamCallback):
    def __init__(self):
        pass
    def process(self, outputStream):
        outputStream.write(bytearray(ioV.outputText.encode('utf-8')))
# end class


When I run this code, some Flowfiles success, and other fails, with this Exception.

"Failed to process session due to org.apache.nifi.processor.execption.ProcessException: javax.script.ScriptException: org.apache.nifi.process.execption.FlowFIleHandlingException: 
..... 
..... 
is already marked for transfer in <script> at line number 196: javax-script.ScriptException:"

Seems that only one flowfile can be outputted for one input flowfile.
Is there another way to solve this?

Splitting before ExecuteScript is not possible, because I do the Regex"Magic" inside the ExecuteScript with the Comment-Entry.

Thanks for any help.
Christian

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Generate multiple FlowFiles with ExecuteScript

New Contributor

Problem solved.
Found an entry from Matt Burgess which solved this very smart. @Matt Burgess Thanks alot


https://community.hortonworks.com/questions/106878/split-one-nifi-flow-file-into-multiple-flow-file-...

1 REPLY 1

Re: Generate multiple FlowFiles with ExecuteScript

New Contributor

Problem solved.
Found an entry from Matt Burgess which solved this very smart. @Matt Burgess Thanks alot


https://community.hortonworks.com/questions/106878/split-one-nifi-flow-file-into-multiple-flow-file-...

Don't have an account?
Coming from Hortonworks? Activate your account here