Member since
07-30-2019
3406
Posts
1622
Kudos Received
1008
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 103 | 12-17-2025 05:55 AM | |
| 164 | 12-15-2025 01:29 PM | |
| 104 | 12-15-2025 06:50 AM | |
| 238 | 12-05-2025 08:25 AM | |
| 400 | 12-03-2025 10:21 AM |
06-04-2018
05:34 PM
1 Kudo
@Artem Anokhin No matter which host URL(s) you use in the configuration of an Remote Process Group (RPG). the RPG will ned up retrieving site-to-site (S2S) details that include all the currently connected nodes in the target cluster. - Included in those S2S details are things like: 1. Hostname of each node - defined by "nifi.remote.input.host= " configured on each node. 2. If "Raw" transport protocol is supported - defined by this property "nifi.remote.input.socket.port=" being set. 3. if "HTTP" transport protocol is supported - defined by this property "nifi.remote.input.http.enabled=" being set to true or false 4. If S2S connection is secure - defined by "nifi.remote.input.secure=" being set to true or false - There is no way to create "node groups" that would only be returned to a source NiFi during the retrieve S2S details phase of communications. - Thank you, Matt
... View more
06-01-2018
07:02 PM
@Jason Sphar Always best to start a new questions as this questions is unrelated to this question. There are multiple versions of the processors for Kafka because each is for a different Kafka client version. GetKafka/PutKafka <--- Kafka 0.8 ConsumeKafka/PublishKafka <--- Kafka 0.9 ConsumeKafka_0_10/PublishKafka_0_10/ConsumeKafkaRecord_0_10/PublishKafkaRecord_0_10 <--- Kafka 0.10 ConsumeKafka_0_11/PublishKafka_0_11/ConsumeKafkaRecord_0_11/PublishKafkaRecord_0_11 <--- Kafka 0.11 ConsumeKafka_1_0/PublishKafka_1_0/ConsumeKafkaRecord_1_0/PublishKafkaRecord_1_0 <--- Kafka 1.0 Thanks, Matt
... View more
05-31-2018
07:07 PM
If NiFi is sitting in a secured environment, why the need to secure NiFi? Could you just leave it http only? There is no work-around to enable http access in to a HTTPS enabled NiFi.
... View more
05-31-2018
06:35 PM
@Jason Sphar *** Forum Tip: Please try to avoid responding to an existing answer by starting a new "Answer". Instead click "Add comment" on the answer you want to add correspondence. There is no guaranteed order to answers in the forum so discussions can get hard to follow. - As far as your new error goes. There is already some other service in this server already bound to that port. You can not have more then one service bind to a specific port. - You could use the following command to see what process id is using that port: # netstat -nap |grep LISTEN - Then you can use following command to see which service is tied to that process id: ps -ef |grep <program/process id> - Thanks, Matt
... View more
05-31-2018
05:37 PM
@Jason Sphar The GetTCP processor is designed to send data to a target TCP port. It sounds like you are trying to recieve data via TCP port in to NiFi? - If that is the case, you want to be using a ListenTCP processor instead that will bind to the tcp port you will be sending your data to. - Thanks, Matt
... View more
05-31-2018
05:32 PM
1 Kudo
@Brandon Spratt You are absolutely correct that older versions of NiFi allowed user to configure both the "nifi.web.http.port" and "nifi.web.https.port" properties in NiFi at the same time. NiFi would at that time then allow any user to access the NiFi UI via the unsecured http URL or via the HTTPS secured URL. - The need client auth property never had anything to do with user access to NiFi. That property was specific to node to node communications only. False simply meant that nodes acting as clients talking securely to other nodes (acting as server) did not need to verify trust of the server's presented certificate in the TLS/SSL handshake. - Allowing user to access a secured NiFi via a http configured URL presents a huge security risk, so that capability was removed. Once NiFi is secured by enabling https, even if http is still configured access will be blocked to the http URL(s). - Can you elaborate on the use case for allowing users to anonymously access a secured NiFi? This opens a security hole where any client (user or other system) can get access to the data passing through that NiFi. - As a work-around you could generate a user certificate that gives all access to every NiFi policy and make that certificate freely available to all your users. - Thank you, Matt - If you find an answer the best addresses your initial question, please take a moment to login to the forum and click the "Accept" link below that provided answer.
... View more
05-31-2018
01:03 PM
2 Kudos
@Rahul Kumar - Where are you getting the nar or jar for this custom influxdb processor from? - Once you have this custom processor nar/jar file, you will want to create a custom lib directory to place it in and then configure your nifi to read that additional custom lib folder location. This is done by adding a new key/value pair to the nifi,properties configuration file: nifi.nar.library.directory.custom-lib=/<path to custom lib dir>/custom-lib - A restart of NiFi will be required before NiFi will load any newly added custom libraries. At that point the new processor shoudl be available to add to the canvas just as you add any other processor. - Thank you, Matt
... View more
05-31-2018
12:52 PM
1 Kudo
@Rahul Kumar - The NiFi "run" directory is where NiFi creates the "nifi.pid" and "nifi.status" files during startup. - You should make sure that the user that owns teh NiFi process has the ability to create files inside the /home/rahul/nifi-1.6.0/run directory. - Your NiFi should have failed to start. Take a look in your nifi-bootstrap.log file to see when the last time you see: org.apache.nifi.bootstrap.Command Starting Apache NiFi... Does the timestamp for that line correspond with your latest attempt to start NiFi? My thought is that their was already a NiFi process running and what you see in browser is really not the same process as to what you think you just started. Run the following command to see what nifi is actually running and how long it has been running: ps -ef|grep "TIME\|nifi-1" - Thank you, Matt
... View more
05-31-2018
10:19 AM
@Mike Wong Does the listFile exhibit the same behavior or does it list your file correctly? - The fact that the logs shows it the processor yielding tells me it found no work to do (meaning no files to list). It yields so that it does not consume not stop CPU looking for work that does not exist. - Did you check your properties for leading or trailing whitespace? Did you try removing the "\" from your file filter? - Thanks, Matt
... View more
05-30-2018
01:05 PM
@Mike Wong You may also want to verify your processor configuration for both input directory and file filter to make sure you do not have any leading or trailing spaces. Spaces are treated as valid characters to NiFi which can result in NiFi not finding the file or even the directory.
... View more