Member since
06-09-2016
185
Posts
22
Kudos Received
5
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2731 | 04-21-2017 07:57 AM | |
| 1741 | 04-18-2017 07:07 AM | |
| 4428 | 02-27-2017 05:41 AM | |
| 1216 | 12-09-2016 11:05 AM | |
| 1603 | 11-24-2016 11:20 AM |
12-08-2016
01:07 PM
4 Kudos
Site-to-site is much more versatile than multi-DC communications (though this is a great use case for this NiFi's feature). S2s can link multiple clusters (or standalone instances), can even connect a cluster to itself (for data re-distribution), as well as used for MiNiFi to NiFi communication. It's also bi-directional, meaning it can be push/pull in either direction. At the end of the day this means you will be able to communicate e.g. over a corporate HTTP proxy regardless of the inbound/outbound firewall rules, there's enough flexibility to accommodate these scenarios in s2s. Read up more here https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#site-to-site
... View more
03-02-2017
01:18 PM
I am using Spark receiver for Nifi.. its not working.. # Site to Site properties
nifi.remote.input.host=localhost
nifi.remote.input.secure=false
nifi.remote.input.socket.port=10000
nifi.remote.input.http.enabled=true
nifi.remote.input.http.transaction.ttl=30 sec
... View more
12-08-2016
01:26 PM
1 Kudo
@Avijeet Dash Every Node in a NiFi cluster run with their own repositories, flow.xml.gz, and work with their own set of data. Nodes in a cluster are unaware of what data other nodes in the cluster are working on. Once a cluster coordinator is elected all nodes send heartbeats to that node. Nodes cannot share repositories.
When you access the UI via any Node in the cluster, the UI will show the cumulative stats of the entire cluster to the user. The centralized management aspect comes in to play here. Any changes you make within NiFi (no matter which node UI you are logged into) will be replicated to all nodes in the cluster. Thanks, Matt
... View more
12-07-2016
05:46 AM
Thanks @mgilman - it works, Thanks for pointing the error in url.
... View more
12-08-2016
12:58 PM
This was a community project of mine. It's not part of NiFi. However, it did validate a few very important use cases and allowed to collect real-world usage patterns. There's a longer-term effort in-flight around SDLC which involves big pieces. E.g. take a look at https://cwiki.apache.org/confluence/display/NIFI/Configuration+Management+of+Flows and https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#custom_properties
... View more
12-06-2016
06:01 AM
thanks, not sure why I was sending 3...
... View more
12-06-2016
06:11 AM
Hi, thanks it worked, I was using a URL like below...then noticed the 'flow', used it and worked fine. localhost:8080/nifi-api/process-groups/cdb54c9a-0158-1000-5566-c45ca9692f85
... View more
12-01-2016
01:29 PM
1 Kudo
Hi Avijeet. This is currently not possible, but do take a look at the following proposal to understand where things are going in the future: https://cwiki.apache.org/confluence/display/NIFI/Configuration+Management+of+Flows
... View more
11-30-2016
09:13 AM
You can also use the commandline: https://community.hortonworks.com/questions/49338/using-the-nifi-rest-api-to-execute-a-data-flow-cre.html
... View more
11-30-2016
03:26 PM
1 Kudo
See comment to answer above on how to get configs to local.
... View more