Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Flume:What is the maximum size of a file channel on Flume 1.4.0?

Flume:What is the maximum size of a file channel on Flume 1.4.0?

New Contributor

What is the maximum size of Flume file channel in Mb? We are planning to use Flume to move around 2Tb/day into HDFS, and want to keep around 4 days of data in file channel in case of a major failure. Is it possible?

 

1 REPLY 1

Re: Flume:What is the maximum size of a file channel on Flume 1.4.0?

Master Guru
Provided you have the adequate space locally available, it is certainly possible. Just ensure to configure the limits listed at http://archive.cloudera.com/cdh4/cdh/4/flume-ng/FlumeUserGuide.html#file-channel appropriately, to contain your 4-day calculated amount of events.
Don't have an account?
Coming from Hortonworks? Activate your account here