Can be created new node automatically in nifi when a node is down?

[#1]

If any node is down, can nifi create new node automatically? The unused node will be ready to use. When a node is down(fail, disconnect or etc.), I just want to use this new node instead of failed node. Can nifi do this automatically? Is this possible?

Thank you.

[#2 · Accepted solution]

@Adam J

Nifi is not capable of spinning up a new node if one goes down,autoscaling is possible in AWS .

AWS Auto Scaling monitors your applications and automatically adjusts capacity to maintain a steady, predictable predefined number of a node if a specifically configured alert is triggered eg Bad health or lost heartbeat.

Kubernetes is another tool that you can use for auto-scaling best if your nifi is containerized

HTH

[#3]

Thank you @Geoffrey Shelton Okot. I dont have any kubernates container for Nifi. As far as I know, Nifi have not any kubernates yaml file. But I think, hortonworks will make kubernates container for Nifi

[#4]

@Adam J

In reality, Kubernetes is an orchestration tool downloadable from kubernetes and then download a nifi as a docker image from docker hub.

Have a look at this preconfigured kubernetes-nifi cluster

HTH