Member since
07-30-2019
3404
Posts
1621
Kudos Received
1003
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 174 | 12-05-2025 08:25 AM | |
| 311 | 12-03-2025 10:21 AM | |
| 585 | 11-05-2025 11:01 AM | |
| 437 | 11-05-2025 08:01 AM | |
| 891 | 11-04-2025 10:16 AM |
05-09-2017
03:53 PM
1 Kudo
@Prabir Guha You can use the replaceText processor to replace tabs with commas in a text/plain input file. lets assume my input file's content has the following value:
I could then configure my replaceText processor to do teh following: The Search Value is set to a tab. The Replacement Value is set to a comma. The resulting content is: Thanks, Matt
... View more
05-09-2017
03:18 PM
@Sunil Neurgaonkar There are Global access policies and Component level access policies. The component level access policies are set against components (processors, input ports, output ports, Remote Process groups, etc...). There are no access policies for the icons in the tool bar used to create dataflows. Component level access policies can be assigned to process groups and sub process groups, or they can be assigned to specific components (processors, labels, input ports, output ports, Remote Process groups, etc...) If I am understanding you correctly, you want to control which dataflow building tools specific users have access to. correct? If so, that level of control does not exist. The assumption is that the admin user assigns different users the ability to view/modify only those users assigned process groups. Once they have modify on a process group, they will be able to use all the icons in the dataflow building toll bar to construct their dataflow. The only acception to that are components marked as restricted (this includes some processors and controller services) which would require the user to have been granted the global access policy to "access restricted components". The implementation of such granular control would be challenging to implement without significant changes in NiFi. Take the following template example:
- Templates can contain process groups, sub-process groups, and controller services. What would the expect behavior be if a user tried to instantiate such a template on to the canvas? Fail all together because it contains components user (TEST1) is not authorized to create? Once a dataflow is created you can set component level access policies very granularly against specific components rather then against the process group they reside in. While this granular access control would limit a user to being able to view/modify the specific component, the user would not be able to add new components to the process group. Thanks, Matt
... View more
05-09-2017
02:24 PM
What policies did you authorize the new user for? A user will not be able to load the canvas if they don't at least have the "view the user interface" global access policies assigned to them. Thanks, Matt
... View more
05-09-2017
02:20 PM
@Sunil Neurgaonkar You should avoid hand editing the users.xml file. Let NiFi do that for you to avoid typos. Can you share what that new error is you are seeing? Thanks, Matt
... View more
05-09-2017
12:45 PM
@Sertac Kaya Glad you were able to get the performance improvement you were looking for by allowing your NiFi instance access to additional system threads. If this answer helped you get to your solution, please mark it as accepted. Thank you, Matt
... View more
05-09-2017
12:41 PM
The "sleep" command is a linux command. The command simply runs and waits the configured amount of time before exiting. Typically this command in linux is found under /usr/bin/sleep. I noticed above is missing the leading "/" . But if it is still not found, try searching your linux for it. It is installed as part of the linux "coreutils" rpm. Matt
... View more
05-09-2017
12:36 PM
1 Kudo
@Gaurav Jain Ideally load-balancing would be handle by the systems pushing data to your NiFI. When that is not possible and you are forced to ingest all data to a single Node in your NiFi cluster, load-balancing must be handled via a dataflow implementation. Using a Remote Process Group (RPG) is the most common solution used to redistribute already ingested data across all node sin a cluster, but you can also use multiple PostHTTP processors (1 for every node in your cluster) and a single ListenHTTP processor to build a FlowFile distribution dataflow. See the following for more info... https://community.hortonworks.com/articles/16120/how-do-i-distribute-data-across-a-nifi-cluster.html Thanks, Matt
... View more
05-09-2017
12:27 PM
@Jatin Kheradiya You have configured the nifi.properties file for your NiFi to use "FQDN_1". What does FQDN_1 resolve to on your NiFi instance? (public a.b.c.d or internal ip a1.b1.c1.d1) What processor are you configuring and how have you configured it? Can you provide screenshot? Thanks, Matt
... View more
05-09-2017
12:20 PM
1 Kudo
@Sunil Neurgaonkar As a side note: No need to configure any of the TLS properties in your login-identity-providers.xml file. Since your authentication strategy is set to "SIMPLE", those property are all ignored and only the Manger DN and password are being used to connect to your LDAP.
... View more
05-09-2017
12:17 PM
2 Kudos
@Sunil Neurgaonkar
It looks like you manually created your users.xml file rather then letting NiFi create it for you. Or you originally had teh initial admin identity configured as "cn=admin,dc=example, dc=org". Once the users.xml and authorizations.xml files are created the first time, changes to NiFi config files will not trigger any updates to these files. NiFi is trying to authorize your user "cn=admin,dc=example,dc=com"; however, this user does not exist in yoru users.xml file, so you are seeing the following error: 2017-05-0915:41:57,250 INFO [NiFiWebServer-17] o.a.n.w.a.c.AccessDeniedExceptionMapper cn=admin,dc=example,dc=com does not have permission to access the requested resource.ReturningForbidden response. A close look at your users.xml file provided above shows your user as: <useridentifier="99412284-acd9-3945-931b-362691f189ff"identity="cn=admin,dc=example,dc=org"/> Their is a mismatch between your ldap user DN and the DN of the user in the users.xml file. dc=com vs dc=org. You can simply manually correct this mismatch in the users.xml file and restart NiFi to fix your authorization issue. Thanks, Matt
... View more