Member since
01-02-2023
55
Posts
1
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
949 | 09-18-2023 04:37 AM | |
1038 | 03-17-2023 06:34 AM | |
1608 | 03-13-2023 01:43 PM |
01-18-2023
01:00 AM
Thanks Matt - I am still banging my head against the wall in attempting to create a basic nifi cluster following the instructions per Apachenifi.org. I did make the change to nifi.state.management.embedded.zookeeper.start=true. I also confirmed that I could ping each of the clients from each other (i have copied each client's hosts file below). I created 3 Ubuntu 22.4 clients using Oracle Virtualbox. I have noticed that when I attempt to telnet into the ports called out for in the scripts e.g., port 2181, telnet returns an error that the connection was refused. I did confirm that the Ubuntu firewall is disabled. In any case, any suggestions/recommendations you might have would be tremendously appreciated! I have provided the items that I have configured below: nifi.properties: nifi.state.management.embedded.zookeeper.start=true nifi.web.https.host=nifi01 nifi.cluster.is.node=true nifi.cluster.node.address=nifi01 nifi.cluster.node.protocol.port=7474 nifi.zookeeper.connect.string=nifi01:2181,nifi02:2181,nifi03:2181 nifi.cluster.flow.election.max.candidates=3 nifi.cluster.protocol.is.secure=true state-management.xml <cluster-provider> <id>zk-provider</id> <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class> <property name="Connect String">nifi01:2181,nifi02:2181,nifi03:2181</property> <property name="Root Node">/nifi</property> <property name="Session Timeout">10 seconds</property> <property name="Access Control">Open</property> </cluster-provider> zookeeper.properties: server.1=nifi01::2888:3888;2181 server.2=nifi02::2888:3888;2181 server.3=nifi03::2888:3888;2181 Additionally, created file named myid in nifi01 in /state/zookeeper with a value of 1, myid, a file named myid in nifi02 in same location with a value of 2, and a file named myid in nifi03 in same location with a value of 3. nifi01 hosts file: 27.0.0.1 localhost 127.0.1.1 nifi01 # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters 192.168.2.22 nifi02 192.168.2.23 nifi03 nifi02 hosts file: 127.0.0.1 localhost 127.0.1.1 nifi02 # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters 192.168.2.21 nifi01 192.168.2.23 nifi03 nifi03 hosts file: 127.0.0.1 localhost 127.0.1.1 nifi03 # The following lines are desirable for IPv6 capable hosts ::1 ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters 192.168.2.21 nifi01 192.168.2.22 nifi02
... View more
01-16-2023
07:01 AM
hello Matt, i am following the instructions from the apache nifi web site for setting up a basic cluster. What value should I be entering into the nifi.zookeeper.root.node field? It currently has /nifi as a value. I installed nifi on the client to /home/dave/nifi-1.19.1. should I set this field to "/home/dave/nifi-1.19.1? Any guidance would be much appreciated!
... View more
01-15-2023
06:34 AM
i have been unable to get a unsecured cluster up and running following the instructions provided on the Apache nifi web site.
... View more
01-15-2023
06:33 AM
Hello Matt - I've spent hours trying to a unsecured cluster set up and running. Regarding your suggestions: 1. I confirmed that the nodes could resolve each other by pinging amongst the 3 nodes. 2. I was not able to get ports free. I kept receiving "connection refused by foreign host". I was unable to resolve this. 3. I confirmed that the firewall in my ubuntu 22.40 clients was not active. I am very disappointed that following the instructions on the Apache nifi site I am unable to get an unsecured cluster up and running in short order.
... View more
01-10-2023
07:59 AM
Matt - I will be able to work on this this pm. when I get home. I will update the ticket. Thanks again for your terrific help! I feel like I'm getting close 🙂 VR, Dave
... View more
01-09-2023
06:59 AM
Thanks so much Matt! I will definitely follow your guidance and update!
... View more
01-07-2023
03:59 AM
I also created the following files (as indicated in the instructions: a file named myid in state/zookeeper (with a value of 1) in nificlient1 a file named myid in state/zookeeper (with a value of 2) in nificient2 a file named myid in state/zookeeper (with a value of 3) in nificlient3
... View more
01-07-2023
03:46 AM
Here is the repeating set of message from the nifi-app.log 2023-01-07 10:25:52,851 WARN [main] o.a.n.c.l.e.CuratorLeaderElectionManager Unable to determine leader for role 'Cluster Coordinator'; returning null org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /nifi/leaders/Cluster Coordinator at org.apache.zookeeper.KeeperException.create(KeeperException.java:102) at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2480) at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:242) at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:231) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:93) at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:228) at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:219) at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:41) at org.apache.curator.framework.recipes.locks.LockInternals.getSortedChildren(LockInternals.java:154) at org.apache.curator.framework.recipes.locks.LockInternals.getParticipantNodes(LockInternals.java:134) at org.apache.curator.framework.recipes.locks.InterProcessMutex.getParticipantNodes(InterProcessMutex.java:170) at org.apache.curator.framework.recipes.leader.LeaderSelector.getLeader(LeaderSelector.java:337) at org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager.getLeader(CuratorLeaderElectionManager.java:281) at org.apache.nifi.cluster.coordination.node.LeaderElectionNodeProtocolSender.getServiceAddress(LeaderElectionNodeProtocolSender.java:46) at org.apache.nifi.cluster.protocol.AbstractNodeProtocolSender.requestConnection(AbstractNodeProtocolSender.java:64) at org.apache.nifi.cluster.protocol.impl.NodeProtocolSenderListener.requestConnection(NodeProtocolSenderListener.java:89) at org.apache.nifi.controller.StandardFlowService.connect(StandardFlowService.java:928) at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:476) at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:892) at org.apache.nifi.NiFi.<init>(NiFi.java:172) at org.apache.nifi.NiFi.<init>(NiFi.java:83) at org.apache.nifi.NiFi.main(NiFi.java:332)
... View more
01-07-2023
03:42 AM
Hello Matt - I let nifi start for over 12 hours and it was still in an unresolved state. Here are the items I changed in each of the respective files from each of the 3 nodes: Zookeeper.properties server.1=nificlient1:2888:3888;2181 server.2=nificlient2:2888:3888;2181 server.3=nificlient3:2888:3888;2181 nifi.properties nifi.state.management.embedded.zookeeper.start=true nifi.cluster.protocol.is.secure=true nifi.cluster.is.node=true nifi.cluster.node.address=nificlient1 nifi.cluster.node.protocol.port=9991 nifi.cluster.flow.election.max.candidates=3 nifi.zookeeper.connect.string=nificlient1:2181,nificlient2:2181,nificlient3:2181 state-management.xml <cluster-provider> <id>zk-provider</id> <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class> <property name="Connect String">nificlient1:2181,nificlient2:2181,nificlient3:2181</property> <property name="Root Node">/nifi</property> <property name="Session Timeout">10 seconds</property> <property name="Access Control">Open</property> </cluster-provider> Any additional suggestions/recommendations would be tremendously appreciated. VR, Dave
... View more
01-06-2023
03:52 AM
Hello Vidya - I will have an opportunity to work with this this weekend and I certainly will mark the appropriate reply as soon as I have had an opportunity to follow Matt's guidance. Thanks so much Vidya and Matt! VR, Dave
... View more
- « Previous
- Next »