Cloudera Community

Community Articles

Find and share helpful community-sourced technical articles.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Will Flume cut off events or event batches when using rollSize or rollInterval in HDFS sink?

Labels (1)
Labels:
avatar
author-rank zstai
New Contributor

Created on ‎12-28-2016 06:18 PM

Flume will not deliver partial events. The rollSize and rollInterval are approximate thresholds and are not hard limits. Once the threshold set by rollSize or rollInterval is met, an entire batch will be drained out to the file before it is rolled. Data should not be split up.

648 Views
0 Kudos
Announcements
Product Announcements
[ANNOUNCE] Cloudera's Open Data Lakehouse for Private Cloud ...
Community Announcements
September 2023 Community Highlights
What's New @ Cloudera
Cloudera Streaming Analytics (CSA) 1.11 with support for Ice...
What's New @ Cloudera
Cloudera Operational Database (COD) supports creating an ope...
What's New @ Cloudera
Cloudera Operational Database (COD) is available as a Techni...
View More Announcements
Labels
Version history
Last update:
‎12-28-2016 06:18 PM
Updated by:
New Contributor
Contributors