Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Flume set up in the the multinode cluster

Flume set up in the the multinode cluster

Contributor

Hi All,

 

We are planning to install and configure flume in our CDH 5.9 cluster.Wanted to know whether we can do single node installation or mulitple node installation is also possible.

 

And what will be advantage of multiple node installation over single node installation?

 

I am new to flume .

 

Please help me with this.

 

Thanks,

Priya

 

4 REPLIES 4

Re: Flume set up in the the multinode cluster

Expert Contributor

It depends on your application usecase. However its good to have multi-node flume agents for resiliency purposes.

 

For example:

Multinode/resiliency/loadbalancer, if you have more data coming in from the source, could scale up number of flume agents

 

  Flume agent 1 - Node 1

  Flume agent 2 - Node 2

  Load balancer/virtual IP(VIP) connecting Node 1 and Node 2

 

Happy Fluming !

 

 

 

Em Jay
Highlighted

Re: Flume set up in the the multinode cluster

Contributor
Thank you for the inputs. Just a query we can install agents on datanodes right.
Please provide your inputs.

Re: Flume set up in the the multinode cluster

Super Collaborator
Correct, you can install flume agents on any node in the cluster.

-pd

Re: Flume set up in the the multinode cluster

Contributor
Thank you for inputs. We can install one flume agent and later add more agents as per requirements right.