Member since
06-17-2019
8
Posts
2
Kudos Received
0
Solutions
11-21-2024
07:59 AM
Thank you @MattWho , Lists3->fetchs3->compress the files(4 or 5 files usually)->put target s3->Fetchs3 again->Puts3 Archive folder->DeleteS3(Remove Original file)->(Check all 5 files are processed till delete, if any one file is missing Route all 5 to Failure else Route all 5 to success) , for this last step , i have used Execute script, now i am looking for Native processors. Kindly let me know if you need more information on this.
... View more
11-21-2024
01:58 AM
1 Kudo
Hi Team, I am trying to implement for the scenario where the events should sleep for 5 minutes and let all the flow files are queued up, then check the count of the files if it is greater than 10 route to failure else route to SUCCESS. I did in Execute script processor as below. However, i am trying to avoid the executescript for this and try to use Native nifi processors. ====== Executescript =============== Thread.sleep(300000) def flowFiles = session.get(100) if (!flowFiles || flowFiles.size() <= 10) { session.transfer(flowFiles, REL_SUCCESS) } else { session.transfer(flowFiles, REL_FAILURE) }
... View more
Labels:
- Labels:
-
Apache NiFi
10-22-2024
10:03 PM
1 Kudo
Thank you drewski7 . It is working for me with expected output. Thank you.
... View more
10-22-2024
05:43 AM
When using the InvokeHttp process for all 4xx HTTP status codes, we receive the HTTP response in the request flow file attribute 'invokehttp.response.body'. However, the attribute holds only 256 characters, and any response bigger than that causes truncation. I would like to hold the entire response body , even it is beyond 256 chars for 4xx status code.
... View more
Labels:
- Labels:
-
Apache NiFi
09-17-2019
12:52 AM
Hi All, I would like to capture the Nifi processor error message due to failure on some reasons. The popup coming up and getting expired in 5 minutes.My plan is the error messages should be captured (like by some Nifi processors) and send it via email.I cannot capture the error messages on the fly. Any thoughts on this please?. Ex: The screenshot has the error message and and i need to capture the entire messages and send via email.
... View more
Labels:
- Labels:
-
Apache NiFi
06-18-2019
01:08 AM
Please let me know if the question is not clear. I will re-write the question again.
... View more
06-17-2019
11:37 PM
HI All, I am trying to iterate the nifi flow file and modify each line in the flow file using python script in 'ExecuteScript'.But it is not working as expected. For example i would like to append 'Rajiv' string at the end for each line in the flow file.but it is adding only at the end of the end of the flow file. Code Execute script content: import json import java.io from org.apache.commons.io import IOUtils from java.nio.charset import StandardCharsets from org.apache.nifi.processor.io import StreamCallback class PyStreamCallback(StreamCallback): def __init__(self, flowfile): self.ff = flowfile pass def process(self, inputStream, outputStream): text = IOUtils.toString(inputStream, StandardCharsets.UTF_8) text = text + 'rajiv' outputStream.write(bytearray(text.encode('utf-8'))) flowFile = session.get() if (flowFile != None): flowFile = session.write(flowFile,PyStreamCallback(flowFile)) session.transfer(flowFile, REL_SUCCESS) Generate flow file input: 1234 5678 output: 1234 5678rajiv Expected output: 1234rajiv 5678rajiv
... View more
Labels:
- Labels:
-
Apache NiFi