Member since
10-24-2016
47
Posts
16
Kudos Received
0
Solutions
01-31-2017
11:28 AM
1 Kudo
@Raj B Please check for the 'Writes Attribute' in 'usage' of the processor. It describes the attribute each processor writes in case of failure. Below is the Usage of 'ExecuteStreamCommand' and it details 4 different error it writes during the execution.
... View more
01-25-2017
07:46 AM
@Raj B You can do this in many ways, 1. You can have an update attribute processor at the beginning of every Processor Group to specify the module name. But this cannot be replicated at processor level. Here, you keep updating the same attribute throughout the flow 2. You have have a 'Metadata' -> as a table or a flat file that will log all the attributes of the flow file. Please check AttributeToJson processor. This can log flow attributes both as an attribute or content. Also, note that every nifi processor adds additional 'error' attribute in case of any error which can be captured by AttributeToJson processor. Hope this helps
... View more
01-04-2017
09:27 AM
I see an option 'Concurrent Tasks' in Scheduling in Nifi version 2.0. Here are my questions regarding Concurrency.
1. I see this only at indivudual processor level. Can this be set at 'Processor Group' level. In short can I parameterize it.
2. How can I arrive at this number. What are all the fators that decide concurrency. E.g. Memory, average data load etc, Other application in the same box like spark.
... View more
Labels:
- Labels:
-
Apache NiFi