Member since
12-22-2016
12
Posts
7
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
15599 | 01-06-2017 04:40 PM |
04-10-2017
02:41 PM
@Matt Clarke - I do not want to go back and forth with you, but my experiences with NiFi clusters have been slightly different than yours. I am in charge large clusters that run that have nodes on separate hosts (32+ nodes). Based on my experiences, I have had many challenges getting all of the nodes to form a cluster with all nodes. My suggestions might be more of a safest approach rather than the conventional method of adding a new node.
... View more
04-10-2017
01:26 PM
@Matt Clarke - you correct about adding the node that way. I play it safe by stopping all processors for my data flows, stopping all of the nodes in my cluster, adding the new node as an entry to the authorizers.xml file, copying the flow.xml.gz file to the conf directory of the new node, and deleting the users.xml and authorizations.xml files (You can do this if and iff you specify an Initial Admin in the authorizers.xml file). Of course generating a certificate for the new node and adding custom processors to the lib directory will be needed. the setback with doing it this way is that I have to re set all of the policies. A member on my team is currently writing a script that will generate authorizations.xml, users.xml and authorizers.xml files on the fly when we add a new node to save time in the long run. Best, Michael
... View more
04-09-2017
03:35 PM
Based on my experiences, I stop all data flows, get a clean (unstarted version of nifi), and copy the flow.xml.gz file from NCM into that new instance. Other actions I do include:
delete the users.xml and authorizations.xml files on each existing node add the new node as an xml entry in the authorizers.xml file for all nodes including the newly added one. (all nodes should have the same authorizers.xml and zookeeper.properties create certificate for that node when using HTTPS mode add custom processors (nar files) to the lib folder if need be
... View more
01-06-2017
04:40 PM
3 Kudos
@Karthik Narayanan I fixed it with something like this. I went into the bootstrap.conf file and added this argument:
java.arg.8=-Duser.timezone=America/New_York references: http://stackoverflow.com/questions/2627992/force-java-timezone-as-gmt-utc and https://confluence.atlassian.com/kb/setting-the-timezone-for-the-java-environment-841187402.html
... View more
01-06-2017
03:57 PM
I have it installed on my server, and the time on my server is the correct with the correct timezone.
... View more
01-06-2017
03:34 PM
1 Kudo
Hi, When I use the Nifi User Interface, I notice that the time is always set to CST, but I live in EST. Is there a setting that I can change to reflect my relevant timezone? Best, Michael
... View more
Labels:
- Labels:
-
Apache NiFi
01-04-2017
07:57 PM
Thank you @Timothy Spann !
... View more
01-04-2017
07:57 PM
1 Kudo
@mpayne, I have five zookeeper instances running and they are configured properly in the zookeeper.properties file. I am not using the embedded zookeepers since I am forming a cluster, and using the embedded zookeepers for each node is not allowed. I never designated a root node since the documentation did not require it. Should I be doing this? I will look into ensuring that all nodes can communicate with all zookeepers. Thank you for the advice!
... View more
01-04-2017
02:54 PM
1 Kudo
@Timothy Spann I did all of these and configured the state-management.xml, zookeeper.properties, nifi.properties, and authorizers.xml files. After much experimentation, I got all five nodes to cluster, and here is what I did from a high level. 1. Get two nodes to cluster 2. For every node thereafter, start and restart each node until the node "joins" the cluster It can be time consuming but it worked.
... View more
12-23-2016
06:17 PM
Hi @Timothy Spann I have set these values that you mentioned, and even updated the zookeeper.properties, state-management.xml , and authorizers.xml files with the appropriate node/port information, but the clustering now goes two sets of two nodes and then one node that does not form a cluster. Best, Michael
... View more