Member since
07-30-2019
3387
Posts
1617
Kudos Received
999
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 119 | 11-05-2025 11:01 AM | |
| 372 | 10-20-2025 06:29 AM | |
| 512 | 10-10-2025 08:03 AM | |
| 355 | 10-08-2025 10:52 AM | |
| 393 | 10-08-2025 10:36 AM |
05-04-2017
06:18 PM
Thanks. Using an external script seems worse in regards to processing time than regex would be and while custom Java processor seems appealing, I don't believe thats the direction we wish to go.
... View more
05-04-2017
04:30 PM
1 Kudo
There is an expression language guide here: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html For your example you should be able to create an UpdateAttribute processor and add a new property like: myfilename = ${filename:substringAfterLast('/')}
... View more
05-08-2017
03:15 PM
@uttam kumar Where either of the above answers able to resolve your template issue? If you found either helpful, please accept the answer. Thank you, Matt
... View more
05-09-2017
12:45 PM
@Sertac Kaya Glad you were able to get the performance improvement you were looking for by allowing your NiFi instance access to additional system threads. If this answer helped you get to your solution, please mark it as accepted. Thank you, Matt
... View more
05-01-2017
03:16 PM
@Gu Gur And just to add a little detail to Matt's comment, from the documentation, Regular Expressions are entered by adding user-defined properties; the name of the property maps to the Attribute Name into which the result will be placed.
... View more
04-27-2017
02:06 PM
2 Kudos
@Anishkumar Valsalam In a Nifi cluster you need to make sure you have uploaded you new custom component nars to every node in the cluster. I do not recommend adding your custom nars directly to the existing NiFi lib directory. While this works, it can become annoying to manage when you upgrade NiFi versions. NiFi allows you to specify an additional lib directory where you can place your custom nars. Then if you upgrade, the new version can just get pointed at this existing additional lib dir. Adding additional lib directories to your NiFi is as simple adding an additional property to the nifi.properties file. for example: nifi.nar.library.directory.lib1=/nars-custom/lib1
nifi.nar.library.directory.lib2=/nars-custom/lib2 Note: Each prefix must be unique (i.e. - lib1 and lib2 in the above examples). These lib directories must be accessible by the user running your NiFi instance. Thanks, Matt
... View more
11-21-2018
10:40 AM
Hi, There is currently no solution other than to swith back to rsa authent. In addition this library won't work if you try to use rsa with custom key length (I tried 4096 and it failed). You have to edit the ssh_config on the sftp server in order to disable ed25519 (or at least set rsa with a higher priority) I invite you to watch the ticket on nifi's JIRA https://issues.apache.org/jira/browse/NIFI-5816 Regards
... View more
04-24-2017
02:15 PM
@Avish Saha Some processors work in NiFi FlowFiles in batches. In your case one of the FlowFiles is failing to match on the regex which is causing a session roll back of the entire session. Also seeing as how the processor reports 8,000,000+ tasks in the last 5 minutes, it does not look like it is penalizing that one bad FlowFile. While all FlowFiles routed to a "failure" relationship are penalized, this is not true for all processors when a session rollback occurs.
... View more
04-25-2017
06:17 PM
@Dmitro Vasilenko The ConsumeKafka processor will only accept dynamic properties for Kafka consumers only. max.message.bytes is a server configuration property. I believe what you are really looking for on the consumer side is: max.partition.fetch.bytes This property will be accepted by the consumeKafka processor and you will not see the "Must be a known configuration parameter for this Kafka client" invalid tooltip notification. Thanks, Matt Just as an FYI, I don't get pinged about any new answers/comments you make without the @<username> notation.
... View more