Member since
07-30-2019
920
Posts
195
Kudos Received
91
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1029 | 10-05-2021 01:53 PM | |
14420 | 09-23-2019 06:03 AM | |
5592 | 05-04-2019 08:42 PM | |
1139 | 06-11-2018 12:45 PM | |
10417 | 06-04-2018 01:11 PM |
12-21-2017
08:20 PM
1 Kudo
@sally sally Check the back pressure object threshold value in the connection feeding the MergeContent processor to make sure it has been changed to a value that will allow enough files to queue up.
... View more
11-16-2017
06:50 PM
@dhieru singh The flow would look something like this: The output from the ListSFTP would go to the Remote Process Group which has the NiFi URL of one of the nodes. There will need to be an inport port at the root level of the NiFi UI, you will use to connect to from the ListSFTP And then the output from that port will go to the FetchSFTP, which in my example is in a process group Do you follow?
... View more
11-15-2017
05:59 PM
@dhieru singh You should set that property to the hostname for each of the nodes in the cluster. So, for node1, it would be nifi.remote.input.host=node1, and node2 would be nifi.remote.input.host=node2 and so on for each node. Then you'll drop a Remote Process Group on the UI. Have you ever used a Remote Process Group before?
... View more
11-02-2017
03:52 PM
@balalaika Try to telnet to smtp.gmail.com on port 25 from the command line on the system running NiFi, does it work?
... View more
11-01-2017
12:46 PM
@dhieru singh With 5 nodes, I would set the nifi.cluster.node.read.timeout and nifi.cluster.node.connection.timeout to 60 secs. In addition, I would set the nifi.cluster.protocol.heartbeat.interval to 15 secs instead of the default of 5 secs.
... View more
10-31-2017
08:32 PM
@dhieru singh If the nifi.cluster.node.protocol.max.threads property is left blank it will default to a value of 50. Which should be more than adequate for most cases. You can set the nifi.cluster.node.protocol.threads=10, that is your lower limit and the max.threads is your upper limit. How many nodes are in your cluster?
... View more
10-27-2017
06:12 PM
1 Kudo
@dhieru singh The GetTCP processor does not pull the data, it simply connects to the configured endpoint and then reads the data on that endpoint. The ListenTCP processor waits for the incoming TCP connection and then reads the data.
... View more
10-25-2017
12:41 PM
@sally sally If the server NiFi is running on shuts down, NiFi when restarted, will come back up in the last known state. So, the state for the ListHDFS processor will be recovered and it will resume the listing from the last known timestamp.
... View more
10-25-2017
11:59 AM
@dhieru singh Thank you for the clarification. From the discussion that was not clear to me.
... View more
10-24-2017
10:08 PM
1 Kudo
@dhieru singh @Shu It will only use your local timezone if the system NiFi is running on is configured to use your timezone. If your system is configured to use GMT, then you will have to adjust your cron schedule to account for the time difference.
... View more