Member since
07-08-2022
3
Posts
0
Kudos Received
0
Solutions
09-17-2022
10:11 PM
Hi, I am trying to develop a custom processor following answers regarding the same. (Ex: https://community.cloudera.com/t5/Community-Articles/Build-Custom-Nifi-Processor/ta-p/244734). My use-case is that I need to add some additional functionality to ListS3 processor. I followed the maven command and successfully generated MyProcessor.java. Could anybody please help me with steps on how I use ListS3 code and edit on top of it. Do I need to clone entire nifi repo or nifi-aws-bundle? If yes, how to integrate nifi-aws-bundle and my nifi-customProcessor-bundle? Tried few solutions recommended but these error still remains - - Cannot resolve symbol 'amazonaws' - Cannot resolve symbol 'list' - Cannot resolve symbol 'AbstractS3Processor' - Cannot resolve symbol 'getLogger' - Incompatible types. Found: 'org.apache.nifi.processors.customProcessor.CustomProcessor.ListedS3VersionSummaryTracker', required: 'ListedEntityTracker<ListableEntityWrapper<S3VersionSummary>>' . . and many similar errors. Thank you for looking into this problem in advance!
... View more
Labels:
- Labels:
-
Apache NiFi
07-09-2022
10:22 AM
Hi @SAMSAL , Firstly, thank you for your response! I keep getting this 'A flowfile is currently penalized and the data cannot be processed at this time' when I hover over the connector between ExecuteProcess and SplitContent, and I guess that's why the split is not working for me. Any idea what I might be doing wrong? Or any setting I need to check? I am using nifi-1.16.2 Really appreciate your help!
... View more
07-08-2022
11:04 PM
Hi, I am using a custom python script (image attached below) in ExecuteProcess processor and it generates flowfiles as result of stdout. The problem I am facing is that for all stdouts, it generates only one flowfile. My requirement is to generate seprate flowfile for each stdout. I tried putting a pattern in stdout and feeding the output flowfile to SplitContent as input. But I keep getting "A flowfile is currently penalized and the data cannot be processed at this time" and it doesn't resolve even after waiting for so long. SplitContent doesn't show any error either, it just doesn't process the splitting. Trying to split the flowfiles based on pattern - "#;#" [PFA the images below] I would really appreciate any help! PS.: Also tried to use ExecuteScript to run custom python script, but I guess since it works on jython, it didn't allow me to import some python packages.
... View more
Labels:
- Labels:
-
Apache NiFi