Have you considered looking at the ListFtp property:   Minimum File Age and set it to 2 hours ... View more

Deleting that state directory should not be a normal maintenance function. What you initially described is a very odd case. The fact that your node went down 003 and if it was the primary node or the coordinator node, internally there would have been a election to nominate a new cluster member node to perform those functions.   In your case node 003 is a member of the cluster but it is not connected. Why it is not connected could be the cause of n reasons typically node is down or it was manually disconnected. When you see that message how many member nodes do you have? I expect the UI to show 2/3 because node 3 is not connected. The solution is to connect it by fixing the issue of why node is down or connect it through the UI     ... View more

This to me sounds like a hostname issue.   could you confirm the value on nifi.properites for: nifi.cluster.node.address= nifi.web.https.host=   Those values should match for the name of the host.   If nothing there stands out check log entries for latest messages contain below strings:   "org.apache.nifi.cluster.coordination.node.NodeClusterCoordinator: Status" "org.apache.nifi.controller.StandardFlowService: Setting Flow Controller's Node ID:" "org.apache.nifi.web.server.HostHeaderHandler"   ... View more

Can I clarify that what you want to do is dealing with XML and XPath? Or based on this "I'm trying to pass an output value of a processor dynamically into another and use it as a new property" Output values in to flowfile attributes depend on the previous processor. If you are not dealing with XML then the processor you most likely need is ExtractText followed by an RouteOnAttribute ... View more

Hi @yogesh_shisode awesome that you are exploring NiFi.   So just to be clear Apache Zookeeper can be considered an external service to help with state management / NiFi clustering With that said and to make things "flow" better, NiFi allows us to start an embedded zookeeper cluster. To me it seems that is what you are trying to connect to given the IP examples, so you are trying to use NiFi's embedded Zookeeper capability. So let's delve a little into zookeeper, we have zookeeper the service that can be single node or multi node. when in multi node we have a zookeeper ensemble and when we have that we need to maintain a quorum. This answer is very eloquently explained https://stackoverflow.com/questions/25174622/difference-between-ensemble-and-quorum-in-zookeeper   And with that said please make sure you follow this guide: https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#embedded_zookeeper   In it it discusses howe to configure the NiFi to start up as an embedded zookeeper service and the settings needed to accomplish this.    For clarity port 2181 is the zookeeper listening port and depending on how many servers you configured to be your zookeeper servers based of this nifi.properties entry:   nifi.state.management.embedded.zookeeper.start=false   if it is set to true, then Nifi will start a zookeeper service too and will depend on this setting: nifi.state.management.embedded.zookeeper.properties=./conf/zookeeper.properties   Which is all explained on the link I gave you https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#embedded_zookeeper   AND once you decide who the member nodes of your zookeeper are then all the NiFi's regardless of wether they are zookeeper servers or not should have this property set:   nifi.zookeeper.connect.string= ^^^ The same on all NiFi's   And using your IP examples if you want 3 servers to be zookeeper servers, then I would expect this setting to be: nifi.zookeeper.connect.string=192.168.0.10:2181,192.168.0.20:2181,192.168.0.30:2181   And on those servers this setting to be: nifi.state.management.embedded.zookeeper.start=true   And the additional configurations from the Apache NiFi admin guide linked above.       ... View more

Just install the right java should be good enough. And if you get more than one JAVA just point JAVA HOME to a proper version for NiFi ... View more

@SAMSAL thanks for confirmation, what java version is the NiFi JVM using?   You can find it multiple ways but maybe easiest is to look at:   Global Configuration Menu ( top right ) > Cluster > Versions tab    Or if single node maybe just finding the java version windows has, assuming not multiple. ... View more

Hi @SAMSAL ,   Could you provide a bit more info. What version of NiFi are you on? Can you provide the script?   If you are using ExecuteScript make sure you are setting groovy as script engine and you do not need to install Groovy separately for ExecuteScript because it runs on the internal JVM using JSR-223 scripting.   So if you are setting Module Directory just because you think you need to set that to point to groovy, try unsetting that.   and can you run a simple script to test this out:     import groovy.io.FileType def flowFile = session.get(); session.transfer(flowFile, REL_SUCCESS)   ... View more