Reply
Expert Contributor
Posts: 143
Registered: ‎08-07-2017

Flume set up in the the multinode cluster

[ Edited ]

Hi All,

 

We are planning to install and configure flume in our CDH 5.9 cluster.Wanted to know whether we can do single node installation or mulitple node installation is also possible.

 

And what will be advantage of multiple node installation over single node installation?

 

I am new to flume .

 

Please help me with this.

 

Thanks,

Priya

 

Highlighted
Expert Contributor
Posts: 126
Registered: ‎11-01-2013

Re: Flume set up in the the multinode cluster

It depends on your application usecase. However its good to have multi-node flume agents for resiliency purposes.

 

For example:

Multinode/resiliency/loadbalancer, if you have more data coming in from the source, could scale up number of flume agents

 

  Flume agent 1 - Node 1

  Flume agent 2 - Node 2

  Load balancer/virtual IP(VIP) connecting Node 1 and Node 2

 

Happy Fluming !

 

 

 

Em Jay
Expert Contributor
Posts: 143
Registered: ‎08-07-2017

Re: Flume set up in the the multinode cluster

Thank you for the inputs. Just a query we can install agents on datanodes right.
Please provide your inputs.
Cloudera Employee
Posts: 273
Registered: ‎01-09-2014

Re: Flume set up in the the multinode cluster

Correct, you can install flume agents on any node in the cluster.

-pd
Expert Contributor
Posts: 143
Registered: ‎08-07-2017

Re: Flume set up in the the multinode cluster

Thank you for inputs. We can install one flume agent and later add more agents as per requirements right.
Announcements
New solutions