Member since
09-29-2015
871
Posts
723
Kudos Received
255
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4266 | 12-03-2018 02:26 PM | |
| 3207 | 10-16-2018 01:37 PM | |
| 4313 | 10-03-2018 06:34 PM | |
| 3172 | 09-05-2018 07:44 PM | |
| 2428 | 09-05-2018 07:31 PM |
02-03-2017
05:42 PM
2 Kudos
The identity mappings in NiFi use regular expressions with capture groups, so you could do: nifi.security.identity.mapping.pattern.kerb=^(.*?)@(.*?)$ nifi.security.identity.mapping.value.kerb=$1 That pattern should match hadoopadmin@FIELD.HORTONWORKS.COM where group 1 would be hadoopadmin and group 2 would be FIELD.HORTONWORKS.COM. Then the value property says use group 1 as the actual identity. The NiFi admin guide has a description: https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#identity-mapping-properties
... View more
02-02-2017
03:26 PM
Not really sure about that one, can you provide the part of logback.xml where you declared the new appender?
... View more
02-02-2017
03:11 PM
Ok in your original question I thought you wanted to add only logstash-logback-encoder-4.7.jar which I think on its own would be fairly safe to be in the lib directory since most other NARs would not be using this JAR, and other logging JARs are already in lib. Putting servler-api and jackson JARs in the lib will likely cause a problem. A lot of NARs use jackson and could be using different versions than what you put in the lib, and NiFi itself runs Jetty which is using the servlet-api and probably is using a different version that the one you put in the lib which I think is causing the problem in this case.
... View more
02-01-2017
06:50 PM
2 Kudos
Any jars directly in the NiFI lib directory are available on the system classpath, and are thus available to all NARs, and the class loading is done parent first, so if foo.jar is in lib and foo.jar is also bundled in a NAR, it will find the one from lib first. Generally it is not recommended to put additional JARs into the NiFi lib directory since it can impact every NAR, and the point of the NARs is for each of them to have isolated class loading. However, in your case if the JAR is just an additional logback JAR to reference classes in logback.xml then you should be ok to put in the lib directory, just be aware that it is now on the classpath for all NARs as well.
... View more
01-30-2017
06:20 PM
3 Kudos
There is a JIRA to improve AttributesToJson to support types besides strings: https://issues.apache.org/jira/browse/NIFI-2359 Currently all flow file attributes are stored as strings so there needs to be a way for the user to indicate the type for each attribute. For example, if attribute "foo" has a value of "true" we don't really know if the user wants true as a boolean or true as a string. A convention could be created where each attribute could have a corresponding type attribute so something like: attr1 = true attr1.type = boolean attr2 = true attr2.type = string
... View more
01-30-2017
04:58 PM
In Apache NiFi 1.x there is no more concept of roles, all users are just users, and users and groups can be added to policies. The concept of "Initial Admin" is just a way for the first user to get into NiFi and started adding more users and creating policies, once NiFi is running it doesn't know that user was the initial admin. The initial admin could grant access to other users to make them have the same permissions as his/her self.
... View more
01-27-2017
07:52 PM
2 Kudos
The value in your Node Identity is just a hostname, it needs to be the full DN like "CN=xxx.field.hortonworks.com, OU=NIFI", it is also case and white-space sensitive so needs to be exactly how the DN would be listed from your cert. If you update the node identities you need to blow away users.xml and authorizations.xml again.
... View more
01-27-2017
07:29 PM
2 Kudos
There is no such thing as "roles" in Apache NiFi 1.x, I would expect that to fail start-up with those role elements. When you receive the insufficient privileges message, what is shown in nifi-user.log? There should be a message with a user identity that was denied and we need to compare that identity to what you entered as your initial admin.
... View more
01-26-2017
05:24 PM
I'm wondering if some records are not making through the processors between SplitAvro and MergeContent, most likely it would be at EvaluateJsonPath. Can you try running this updated template and see if any flow files go to any of the LogAttribute processors? hcc-mergecontent-issue-support-updated.xml
... View more
01-26-2017
01:56 PM
Can you post a template of your flow (the XML file from exporting a template)? I don't think I could help much more without seeing your exact flow. https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#templates
... View more