@siddharth pande ideally we use three node to be considered as part of zookeeper server. ... View more

@siddharth pande I think above reply answers your question. Still if you have any doubt or confusion, let us know. ... View more

@siddharth pande you need to edit zookeeper.conf only if you want this node to be part of embedded zookeeper server. Since i just need my node to be part of cluster and i did not want my node to part of zookeeper server and hence i did not modify zookeeper.properties and also had set nifi.state.management.embedded.zookeeper.start as false. If i want to add my current node as part of zookeeper server then i have to enable embedded zookeeper in nifi.properties and also modify zookeeper.properties to add my current node as another zookeeper server, And also i can add this node as part of zookeeper connection string. If we don't want our current node to be part of zookeeper server then current node will be only zookeeper client and for that only connection string is enough to connect to existing zookeeper server. ... View more

@siddharth , no, i did not edit nifi.zookeeper.connect.string in existing 2 nodes' nifi.properties file. I just provided zookeeper connection string to new node and also configured cluster properties like enabling cluster. With this, once you start node it check if it has to start in cluster mode and then looks for any leader is there. In this case a leader will be available and to that leader it will send its heartbeat. ... View more

@siddharth, i don't think you need to bring down the cluster. I had tried below scenario and works properly. Had 2 node cluster. we have to do all cluster related configuration in nifi.properties and provide zookeeper connect string (as provided in your earlier node for property nifi.zookeeper.connect.string) so that this node will get to know who is cluster coordinator or primary node. ... View more

@Edward Blair I had run nifi docker with docker-compose command. Below link has nice description how to run it. https://github.com/apache/nifi/tree/master/nifi-docker/docker-compose I had used command as below docker-compose up --scale nifi=3 -d (this will spawn 3 node nifi cluster) Since in container nifi is running on port 8080. We can get exposed port with below command. docker-compose port nifi 8080 Above returns me o/p as 0.0.0.0:32773 So i can access nifi ui with below url http://<hostname>:32773/nifi ... View more

@Rangareddy Y you can take help of file filter. ... View more

@Rangareddy Y say you have two directory /company_shared/nas_data/home & /company_shared/sas_data/home in input directory you specify like: /company_shared/ in your path filter you can specify like : nas_data/home|sas_data/home recursively it will go through all folder of input directory and tries to match it path filter regex. accordingly it will pick files ... View more