Member since
07-30-2019
333
Posts
356
Kudos Received
76
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9887 | 02-17-2017 10:58 PM | |
2302 | 02-16-2017 07:55 PM | |
7993 | 12-21-2016 06:24 PM | |
1762 | 12-20-2016 01:29 PM | |
1237 | 12-16-2016 01:21 PM |
08-27-2016
08:43 PM
2 Kudos
Randy, there is a directory within NiFi under conf IIRC. However, this will not work as easily in a cluster. The right way is to download templates via a REST api, see what UI is doing under the hood.
... View more
08-17-2016
08:06 PM
2 Kudos
Hi, start by simply running it with defaults. Very often the client won't even have enough data generated for processing to warrant any changes from defaults. Next, if you see connections backlogging, change the number of concurrent instances for a specific processor (but bump by 1 only and re-test). Rinse and repeat. If you still need more, in NiFi Flow UI, in the global settings, you can increase the thread pool size available to the instance (might need to restart in this case, don't remember right now).
... View more
08-11-2016
01:30 PM
1 Kudo
How did you develop the custom processor? Have you used NiFi's maven-generated project structure? If yes, the build phase will have generated the NAR file which includes all dependencies and you drop it in NiFi's lib dir next. For external configuration artifacts for your processor, look into having a known location accessible by every node (e.g. http or nas), so the processor can read those. There's work under way around Variable Registry to provide a much better story as well.
... View more
08-03-2016
02:14 PM
One would need to traverse from the root group and down to your processor to find it (or use Search api to get the processor ref). In any case, some additional logic in your script if you wanted to avoid hardcoding the processor uuid. On another note, what are you trying to achieve? Can you do it by using built-in cron scheduling in processors? NiFi flows are generally designed to always run, not turned on and off like a workflow with dependencies.
... View more
08-02-2016
03:05 PM
3 Kudos
Yes, use a ReplaceText processor and NiFi's Expression Language syntax to reference your attributes and construct the content line. Tip: switch the evaluation mode for ReplaceText to 'Always Replace' as an optimization for your use case. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.ReplaceText/index.html https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html
... View more
07-05-2016
12:26 PM
This service isn't official, and look like it's trying to download a very old NiFi version. Until an official Ambari service is released I recommend you simply download and install yourself, it's trivial (just change the port from the default 8080 in conf/nifi.properties to avoid conflicts).
... View more
06-24-2016
01:18 PM
4 Kudos
Yes. You can refer to the reference docs or read articles here on HCC like this one, for example: https://community.hortonworks.com/articles/7341/nifi-user-authentication-with-ldap.html
... View more
06-22-2016
05:08 PM
1 Kudo
Can you check you properly publish this relationship, too? E.g. see how I am doing it here (and the getRelationships() method that follows) https://github.com/aperepel/nifi-csv-bundle/blob/master/nifi-csv-processors/src/main/java/org/apache/nifi/processors/csv/ParseCSVRecord.java#L141
... View more
06-22-2016
04:15 PM
Ok, so this is a sandbox. Have you configured port forwarding for this VM?
... View more
06-22-2016
04:12 PM
1 Kudo
Are you declaring any relationships? Don't forget to add it to the list of supported ones returned from one of the callbacks. If you can post a link or share the code somewhere, that would be very helpful.
... View more