Member since
07-30-2019
3421
Posts
1628
Kudos Received
1010
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 178 | 01-13-2026 11:14 AM | |
| 309 | 01-09-2026 06:58 AM | |
| 567 | 12-17-2025 05:55 AM | |
| 628 | 12-15-2025 01:29 PM | |
| 581 | 12-15-2025 06:50 AM |
02-16-2017
05:03 PM
1 Kudo
Hello, We have a requirement to anonymize IP address. So we would identify IP address and replace the last part with some arbitrary value. We have tried using the following regex for that (with "Regex Replace" for replacement strategy, "Line-by-Line" as evaluation mode) (1) \\d{1,3}\\.\\d{1,3}\\.\\d{1,3}\\.\\d{1,3} (2) ^(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\.){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])$ (3) ((25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.){3}(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?) None of this works. Can you help me with the right value of regex we can use and the replacement value as well. Thank you in advance!
... View more
Labels:
- Labels:
-
Apache NiFi
02-16-2017
04:02 PM
@mayki wogno Setting /tmp will cause listHDFS to produce a listing of files in all 4 of your directories. Following that listing, use a routeOnAttrinute processor to auto-terminate andy listing that were not from /tmp/toto or /tmp/truc before feeding what FlowFiles are left down the rest of your dataflow.
... View more
02-16-2017
03:44 PM
@marksf Correct, the "key" icon will allow you to apply component level access policies to your process group with id "863928d5-12e7-...." Once "view the component" is granted the ID will be replaced with the actual process group name.
"Modify the component" will allow the user to also add, modify and delete components within that process group. Thanks, Matt
... View more
02-16-2017
03:37 PM
2 Kudos
@marksf The access policies granted via the global access policies found in the upper right hand corner of the UI are used for NiFi controller level policies. What you need to add are component level access policies that will grant users the ability to interface with the canvas in the from of adding, modifying, and removing components. This is done through the "Operate" panel found on the left hand side of the canvas: Select the key icon to open the access policies for the selected component. In the screenshot above the root canvas "NiFi Flow process group" is selected. Access policies applied to a process group are inherited by by all sub-process groups and components by default. IN order for users to be able to add/modify/remove components, they must be granted the "view the component" and "modify the component" access policies. Thanks, Matt
... View more
02-16-2017
03:04 PM
@Anshuman Ghosh No inconvenience at all. We just want to keep it as easy as possible for community members to find similar issues and solutions. I would have moved it myself if I couldhave. 🙂
... View more
02-16-2017
02:48 PM
1 Kudo
@Anshuman Ghosh Tip: Make sure you tag your question with NiFi, so that the community of NiFi followers are notified about your new question.
... View more
02-16-2017
02:40 PM
1 Kudo
@Anshuman Ghosh Please open a new question for this issue rather then attaching to a question with an existing answer. While dealing with the same processor, the problem is different and it benefits the community to have it addressed under its own question. Thanks, Matt
... View more
02-16-2017
02:26 PM
3 Kudos
@Andy Liang Most features of NiFi use two-way SSL while few allow for use of only One-way SSL. Anything that is "machine" to "machine" requires two-way SSL. So using features like NiFi's Site-to-Site or SSL Context Controller services all utilize two-way SSL. NiFi access to the UI only uses one-way ssl. Thnaks, Matt
... View more
02-16-2017
01:22 PM
1 Kudo
@Timothy Spann NiFi is not coming up or the NiFi UI can't be accessed? Is NiFi actually shutting back down after you start it? I suggest you try setting the following property to false in the nifi.properties file and restart your NiFi to see fi you can then access your UI to remove the problematic components: nifi.flowcontroller.autoResumeState=false If using Ambari to manage your NiFi, uncheck the box: Thanks, Matt
... View more
02-16-2017
01:11 PM
@Sonny Heer The HDP stack does not include NiFi. HDF is an entirely different software stack managed by its own Ambari and is installed on its own hardware. There are some post out there that will walk you through manually adding the NiFi service to an existing HDP stack; however, doing so breaks the upgradeability of your HDP stack. Here is an example of that: https://github.com/abajwa-hw/ambari-nifi-service *** Pay special attention to the "Limitations" noted on the above link. At some point in the future there will be an Ambari platform that can be used to install both HDP and HDF stack services that will still support the upgradeability, but that is not here yet and I don't know hen that will happen. Thank you, Matt
... View more