Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can be created new node automatically in nifi when a node is down?

Solved Go to solution

Can be created new node automatically in nifi when a node is down?

Contributor

If any node is down, can nifi create new node automatically? The unused node will be ready to use. When a node is down(fail, disconnect or etc.), I just want to use this new node instead of failed node. Can nifi do this automatically? Is this possible?

Thank you.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Can be created new node automatically in nifi when a node is down?

Mentor

@Adam J

Nifi is not capable of spinning up a new node if one goes down,autoscaling is possible in AWS .

AWS Auto Scaling monitors your applications and automatically adjusts capacity to maintain a steady, predictable predefined number of a node if a specifically configured alert is triggered eg Bad health or lost heartbeat.

Kubernetes is another tool that you can use for auto-scaling best if your nifi is containerized

HTH

3 REPLIES 3

Re: Can be created new node automatically in nifi when a node is down?

Mentor

@Adam J

Nifi is not capable of spinning up a new node if one goes down,autoscaling is possible in AWS .

AWS Auto Scaling monitors your applications and automatically adjusts capacity to maintain a steady, predictable predefined number of a node if a specifically configured alert is triggered eg Bad health or lost heartbeat.

Kubernetes is another tool that you can use for auto-scaling best if your nifi is containerized

HTH

Re: Can be created new node automatically in nifi when a node is down?

Contributor

Thank you @Geoffrey Shelton Okot. I dont have any kubernates container for Nifi. As far as I know, Nifi have not any kubernates yaml file. But I think, hortonworks will make kubernates container for Nifi

Re: Can be created new node automatically in nifi when a node is down?

Mentor

@Adam J

In reality, Kubernetes is an orchestration tool downloadable from kubernetes and then download a nifi as a docker image from docker hub.

Have a look at this preconfigured kubernetes-nifi cluster

HTH

Don't have an account?
Coming from Hortonworks? Activate your account here