Member since
05-10-2016
303
Posts
35
Kudos Received
0
Solutions
02-22-2017
01:54 PM
@mayki wogno No problem... If one of the answers help drive you to a solution to your question, please accept that answer to help drive this community forward.
... View more
03-17-2017
03:53 PM
Can you use the "matches" function in expression language? It should allow any regular expression: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#matches
... View more
04-06-2017
08:16 AM
@artem : thanks for tuto Do you know about this error with oozie : "oozie error workflow manager kerberos" ? thanks
... View more
02-07-2017
02:12 PM
Thanks Bryan 🙂 I found this REST API for Create Template but it is not clear how put "the name" of template .. curl -H "Content-type: application/json" --cacert nifi-cert.pem --cert ./client.p12 -X POST https://nifi001:9443/nifi-api/process-groups/f706d939-0157-1000-9f32-971cfab12b7f/templates
thanks for help
... View more
02-03-2017
02:18 PM
Hi all, I'll found that some wrong. So if you need use logstash-encoder with NIFI. Make these modifications : Links jackson jar from bootstrap to lib lrwxrwxrwx 1 root root 71 Feb 3 15:04 jackson-annotations-2.6.0.jar -> lib/bootstrap/jackson-annotations-2.6.0.jar
lrwxrwxrwx 1 root root 64 Feb 3 15:04 jackson-core-2.6.1.jar -> lib/bootstrap/jackson-core-2.6.1.jar
lrwxrwxrwx 1 root root 68 Feb 3 15:04 jackson-databind-2.6.1.jar -> lib/bootstrap/jackson-databind-2.6.1.jar
Add logstash-logback-encoder-4.7.jar to lib and configure logback.xml with Appender.
... View more
01-06-2017
06:05 AM
1 Kudo
@mayki wogno I have tested RFA appender for Falcon logs . Please make below changes in Falcon log4j.xml .(Example - Metric logs) <appender name="METRIC" class="org.apache.log4j.RollingFileAppender">
<param name="File" value="${falcon.log.dir}/${falcon.app.type}.metric.log"/>
<param name="Append" value="true"/>
<param name="Threshold" value="debug"/>
<param name="MaxBackupIndex" value="10"/>
<param name="MaxFileSize" value="2048"/>
<layout class="org.apache.log4j.PatternLayout">
<param name="ConversionPattern" value="%d %m%n"/>
</layout>
</appender>
You can set MaxBackupIndex(Number of files) and MaxFileSize(Size in Bytes) as per you environment. Also, You can set it similarly for other logs like audit logs etc.
... View more
12-26-2016
06:43 PM
1 Kudo
@mayki wogno user defined arguments aren't really sent to ExecuteScript. If the value of the `filename` attribute is needed, it can be retrieved from the flow file itself. Below is an example of how to retrieve the `filename` attribute, update the attribute, and send the flow file to a `success` relationship. flowFile = session.get()
if (flowFile != None):
filename = flowFile.getAttribute("filename")
flowFile = session.putAttribute(flowFile, "filename", filename + "new_name")
session.transfer(flowFile, REL_SUCCESS)
For an example that is a little more in depth, you can download a template from this gist. For a deeper look into developing with NiFi, please see the developer's guide.
... View more
12-15-2016
01:43 PM
1 Kudo
If you do a GET for the root group using /process-groups/{id} then that response will have all the other process groups under it, you can look at the ProcessGroupEntity example JSON response, and then component -> contents -> processGroups or processors. The root group id won't change so that should be your starting point.
... View more
06-28-2017
09:19 AM
Hi thanks for tuto. Do you know if it is possible to use "StoreInKiteDataset" with kerberos to write to HDFS ?
... View more
04-02-2018
04:21 PM
Zhen Zang, Thanks for
the updated document and information! I’m
still struggling with the best way to determine how much of the JVM CPU, memory,
I/O, etc. each NiFi processor is using. Thanks,
... View more