Member since
04-13-2018
44
Posts
0
Kudos Received
0
Solutions
01-07-2019
12:05 PM
Hi, Iam using Nifi 1.3 version and this is the flow..getsftp->putsftp->putsftp. But at times after the files are picked by getsftp,say if its 190 bytes then putsftp transfers as 0 bytes. It doesnot happen all the time but at times. Please find below the error: 2019-01-07 02:00:01,272 ERROR [Timer-Driven Process Thread-7] o.a.nifi.processors.standard.PutSFTP PutSFTP[id=XXX] PutSFTP[id=XXX] failed to process session due to org.apache.nifi.processor.exception.MissingFlowFileException: Unable to find content for FlowFile: {}
org.apache.nifi.processor.exception.MissingFlowFileException: Unable to find content for FlowFile
at org.apache.nifi.controller.repository.StandardProcessSession.handleContentNotFound(StandardProcessSession.java:3003)
at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2157)
at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2106)
at org.apache.nifi.processors.standard.PutFileTransfer.onTrigger(PutFileTransfer.java:127)
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.nifi.controller.repository.ContentNotFoundException: Could not find content for StandardContentClaim [resourceClaim=StandardResourceClaim[id=XXX, container=default, section=490], offset=0, length=190]: Stream contained only 0 bytes but should have contained 190
at org.apache.nifi.controller.repository.io.FlowFileAccessInputStream.ensureAllContentRead(FlowFileAccessInputStream.java:49)
at org.apache.nifi.controller.repository.io.FlowFileAccessInputStream.read(FlowFileAccessInputStream.java:84)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:284)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at com.jcraft.jsch.ChannelSftp._put(ChannelSftp.java:636)
at com.jcraft.jsch.ChannelSftp.put(ChannelSftp.java:540)
at com.jcraft.jsch.ChannelSftp.put(ChannelSftp.java:492)
at org.apache.nifi.processors.standard.util.SFTPTransfer.put(SFTPTransfer.java:543)
at org.apache.nifi.processors.standard.PutFileTransfer$1.process(PutFileTransfer.java:135)
at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2136)
... 14 common frames omitted
2019-01-07 02:00:01,272 WARN [Timer-Driven Process Thread-7] o.a.nifi.processors.standard.PutSFTP PutSFTP[id=015b10b1-853c-1b95-d98f-915e12c396bd] Processor Administrat
ively Yielded for 1 sec due to processing failure
2019-01-07 02:00:01,273 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding PutSFTP[id=XXX] due to uncaught Exception: org.apache.nifi.processor.exception.MissingFlowFileException: Unable to find content for FlowFile Can you please help me in finding why the files are transfered as 0 bytes?
... View more
Labels:
- Labels:
-
Apache NiFi
12-13-2018
04:53 AM
@Matt Clarke we are using Nifi 1.7 version and the above said configurations are not present.I had tried using the groovy script. def flowFiles = session.get(50)
if(!flowFiles || flowFiles.size() < 50) { session.rollback()
} else {
def flowFile = session.create(flowFiles)
session.provenanceReporter.join(flowFiles, flowFile) session.remove(flowFiles) session.transfer(flowFile, REL_SUCCESS)
} But the files are not getting processed,its stuck in queue.Can you please any solution
... View more
12-12-2018
01:06 PM
@Matt Clarke Can you please help me out
... View more
12-12-2018
10:30 AM
@Matt Clarkecan you please help
... View more
12-12-2018
10:29 AM
Hi, I have a flow where it puts 50 files in destination using putsftp processor.I need to make sure that the 50 files has reached destination.I have tried using mergecontent but since its clustered nifi with 10 nodes,its not possible.Can you please suggest a solution.
... View more
Labels:
- Labels:
-
Apache NiFi
12-08-2018
01:49 AM
@Matt BurgessI had the similar scenario where i needed the count of flowfiles generated but the script is not working.The incoming queue is queued with the flowfiles and its not getting processed.Is it because its a clustered nifi.Can you please help?
... View more
12-01-2018
06:35 AM
@Matt ClarkeHi Matt..i tried the above configuration but the 136 files are not getting merged in one go.Its getting merged in number of 20 and 15.I had set the bin age to 5mins.I wanted a single notification after merging the 136 files.Can you please help
... View more
11-27-2018
06:42 AM
Hi, I have a flow wherein there is expected to have 136 flowfiles and after receiving the same,its to be notified via putemail. The flow will be putfile->mergecontent->putemail.My doubt is how we can exactly ensure136 flowfiles . Is the property max group size dependent on the size of flowfiles,as the size of these files varies day by day.So the only option is to set max bin age? @Shu can you please help?
... View more
Labels:
- Labels:
-
Apache NiFi