Member since
09-29-2015
871
Posts
723
Kudos Received
255
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3347 | 12-03-2018 02:26 PM | |
2302 | 10-16-2018 01:37 PM | |
3614 | 10-03-2018 06:34 PM | |
2387 | 09-05-2018 07:44 PM | |
1814 | 09-05-2018 07:31 PM |
06-26-2018
03:11 PM
ListSFTP is a source processor that does not accept incoming flow files. It is made to track the state of a specific directory on a specific host and find new files, so if those values can change at anytime then the state needs to be reset. This is challenging if those values can change on any given execution while the processor is running, so for this reason the processor does not support incoming flow files and the values can only be changed by stopping and starting the processor with new configuration.
... View more
06-26-2018
01:31 PM
The Correlation Attribute property is the name of one attribute, so if you want to correlate on two attributes you need to make a new attribute that is the combined value of the two attributes, or do the back to back merge as you mentioned.
... View more
06-26-2018
12:52 PM
2 Kudos
Before MergeContent you can put an UpdateAttribute processor and create a new attribute "xx_yy" with the value of ${xx}_${yy} then in MergeContent put xx_yy as the correlation attribute.
... View more
06-22-2018
03:13 PM
The documentation for the processor is here: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-kafka-0-9-nar/1.6.0/org.apache.nifi.processors.kafka.pubsub.PublishKafka/index.html It says... Dynamic Properties: Dynamic Properties allow the user to specify both the name and value of a property.
The name of a Kafka configuration property. The value of a given Kafka configuration property. These
properties will be added on the Kafka configuration after loading any
provided configuration properties. In the event a dynamic property
represents a property that was already set, its value will be ignored
and WARN message logged. For the list of available Kafka properties
please refer to:
http://kafka.apache.org/documentation.html#configuration.
... View more
06-21-2018
02:29 PM
2 Kudos
There should be a property called "Message Key Field" which is the name of the field in the records that you want to use as the message key. It depends how your CsvReader is configured... if it is creating a schema from the column headers then this value would be the name of the column, or if you are providing a specific schema then it would be the name of the field from the schema your provided.
... View more
06-19-2018
06:40 PM
If you want the value to persist for the liftetime of the processor across restarts of NiFi, then you will want to use the state manager, example: https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-update-attribute-bundle/nifi-update-attribute-processor/src/main/java/org/apache/nifi/processors/attributes/UpdateAttribute.java#L244-L245 If you only care about the value from the time the processor is start until it is stopped, then you can just have a simple member variable of the processor hold an integer counter or whatever type.
... View more
06-19-2018
04:45 PM
It is not clear whether you are talking about processor properties or flow file attributes, these are two different things. A flow file attribute is retrieved using session.getAttribute A processor property value is retrieve by using context.getProperty(NAME) While a processor is running, you cannot change it's properties, you can only obtain the values using the context.
... View more
06-19-2018
04:41 PM
2 Kudos
ListSFTP writes two attributes on each flow file - filename and path. In FetchSFTP you want to set the remote file to be a dynamic expression that uses these attributes: ${path}/${filename}
... View more
06-16-2018
12:50 PM
Please show the configuration of your AvroReader, specifically how the schema access strategy is configured.
... View more
06-13-2018
07:50 PM
2 Kudos
The queue before the WW processor shows 0 flow files queued so there is nothing to pull. Also, since the queue between XX and ZZ is showing that it is full, this means back-pressure is engaged and the XX processor will no longer execute until space is available in that queue, which then has the side-effect that XX also can't put more flow files into the queue before WW.
... View more