Member since
07-30-2019
3427
Posts
1632
Kudos Received
1011
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 71 | 01-27-2026 12:46 PM | |
| 482 | 01-13-2026 11:14 AM | |
| 986 | 01-09-2026 06:58 AM | |
| 899 | 12-17-2025 05:55 AM | |
| 960 | 12-15-2025 01:29 PM |
06-12-2017
01:18 PM
@Ahmad Mehr When you start NiFi, the UI does not become available until the application has completed loading. /bin/nifi.sh status The above command simply shows that the application is running, but does not indicate the UI is available yet. To verify that NiFi has completed the startup process and the UI is now available, you will need to look in the nifi-app.log for the following lines: 2017-06-12 09:16:16,029 INFO [main] org.apache.nifi.web.server.JettyServer NiFi has started. The UI is available at the following URLs:
2017-06-12 09:16:16,029 INFO [main] org.apache.nifi.web.server.JettyServer http://<HOSTNAME>:8075/nifi
2017-06-12 09:16:16,031 INFO [main] org.apache.nifi.BootstrapListener Successfully initiated communication with Bootstrap
2017-06-12 09:16:16,031 INFO [main] org.apache.nifi.NiFi Controller initialization took 14617467433 nanoseconds. Until you see these log lines, the UI will not be accessible. You can also run the following linux command to see if "something" is listening on port 8075 yet: netstat -ant|grep LISTEN|grep 8075 Thank you, Matt
... View more
06-09-2017
03:51 PM
3 Kudos
@Eric Lloyd Input and Output ports are designed to send or receive data from one level up. When an input or output port is added at the root canvas level the one level up is another out of the system. You will also notice that ports added to the root canvas are rendered a little differently. There is an open Apache Jira on this subject, feel free to add your comments and use case to it: https://issues.apache.org/jira/browse/NIFI-2933 The current feeling is that adding Remote input and output ports should be left to the system administrator. This is because in a secured connection the admin must add the connecting systems as new users and authorize them to access these ports. Users are not typically granted this level of access. Thanks, Matt
... View more
06-08-2017
04:08 PM
@Daniel Frank If you use @Matt Clarke in your response, I do not get an email notification. I am not following how you use the filename and path to file (B) to parse a totally different file (C) from the filesystem. Have you looked at the FetchFile processor. It accepts a FlowFile as input and uses attributes set on the incoming FlowFile to specify what file to fetch and from where. So you could getFile (B), extract what you need from file (B) into attributes that FetchFile can use to get File (C). FetchFile will stream the content of file (C) into the FlowFile originally belonging to File (B); however, the resulting FlowFile will retain all the FlowFile Attributes that already existed on FlowFile (B). Thanks, Matt If you found this answer addressed your question, please mark as accepted to close out this thread in the community.
... View more
06-08-2017
02:18 PM
@Daniel Frank What format is your data in? (text?) Is all the information you need in the content of these files? The getFile processor already writes attributes for the following on every FlowFile it creates: You could use the ExtractText processor to read the FlowFile content and extract bits to FlowFile Attributes. Thanks, Matt
... View more
06-08-2017
02:05 PM
@Anthony Murphy NiFi is designed to be resilient. It is designed to restore processor to last known state on startup (That state may be enabled, disabled, started, or stopped.) Are you sure these component processors where not stopped before the abrupt shutdown/restart of the server occurred? This is odd since you say it only happens occasionally. And I will be honest, this is the first time i have heard this issue. Is it always the same processors that fail to start? Are the processors that fail to start configured to use any NiFi Controller services? if so, are those Controller Services failing to start also? Check the nifi-app.log during startup to see if their were any logged ERROR or WARN messages related to these processor or controller services on startup. Thanks, Matt
... View more
06-08-2017
12:50 PM
1 Kudo
@Mahmoud Shash There was a bug identified in the Controller service UI of HDF 2.1.3. This bug affected users ability to modify, enable, disable and delete controller services. The HDF 2.1.3 release was pulled down. This bug was addresses in HDF 2.1.4. If you upgrade to HDF 2.1.4 you will be able to successfully access the Controller services in the CS UI. Thanks, Matt
... View more
06-08-2017
12:17 PM
1 Kudo
@Anishkumar Valsalam There are two parts that need to be successful to access NiFi: User authentication: In your case, you are using LDAP to authenticate your users. The NiFi login-identity-providers.xml is used to configure the ldap-provider. NiFI offers two supported configurable "Identity Strategy" options (USE_DN or USE_USERNAME). USE_DN is the default. With "USE_DN" the full DN returned by LDAP after successfully authenticating a used. With "USE_USERNAME" the username entered at login will be used. Which ever strategy is used, the value used will be passed through any configured "Identity Mapping Properties" in NiFi before the resulting mapped value is passed to part two. (Review LDAP settings and Identity mapping Properties in NiFi Admin guide for more details on setup) User Authorization: In you case, you are using Ranger for user authorization. (default is NiFi's file-based authorizer). The final value derived form step one above is passed to the configured authorizer to determine what NiFi resources that authenticated user has been granted access. Based on your output above, you appear to have two options possibly to match your authenticated value with your ldap sync'd user in Ranger: Configure an "Identity Mapping Property" in NiFi that will extract on the value from CN= from the entire returned DN.
Based on the DN pattern you shared, your pattern mapping would look like this:
nifi.security.identity.mapping.pattern.dn=^CN=(.*?), OU=(.*?), OU=(.*?), OU=(.*?), DC=(.*?), DC=(.*?), DC=(.*?)$nifi.security.identity.mapping.value.dn=$1 This will return just "anish" from the DN and that is what will be passed to the authorizer.
Change your "Identity Strategy" configuration in your login-identity-providers.xml file to use "USE_USERNAME". This assumes the username supplied at login matches exactly with the LDAP sync username.
Add/Modify the following line in your ldap-provider: <property name="Identity Strategy">USE_USERNAME</property> Thanks, Matt
... View more
06-07-2017
05:50 PM
@Anishkumar Valsalam I asked around and those quicklinks hostnames are set to the hostnames of the hosts you added to Ambari. You terminal window output above shows you logged into "server1" and not "nifi.server1.com". I could find no way to change them. If you are configuring your nifi.properties file manually, those config changes will be overwritten when you restart NiFi via Ambari. In Ambari, if you configure the nifi.web.https.host= property to a static vale of "nifi.server1.com" , then every node in your NiFi cluster will try to start with that hostname value unless you create a unique config group in Ambari fro each node in your cluster. Wish I could be more help, but it was never the intention of NiFi managed via Ambari to bind to different hostnames then what was provided during your Ambari host registration. I think you only option here is to use config groups, but again that will not change the quicklink URLs. Thanks, Matt
... View more
06-07-2017
03:28 PM
@Anishkumar Valsalam Standalone NiFi instances have no need to perform and 2-way TLS negotiations. Once you cluster, NiFi nodes need to communicate with each other and that negotiation uses 2-way TLS. Not sure where you got your keystore and truststore files from, but you need to verify that the contents of both are correct. The truststore.jks file should contain the necessary trustedCertEntries so that it can trust the client certificate being presented from the other nodes in your cluster. Matt
... View more
06-07-2017
02:46 PM
@Anishkumar Valsalam The Ambari quicklinks URLs are not driven by any of the NiFi configurations. Those quicklinks are driven by the hostname provided when you initially added hosts to your Ambari managed cluster. Since this is not a NiFi configuration issue, I am not sure where to change these quicklink URL values within Ambari. Matt
... View more