I am working on flume and i am using spooldir to save files in hdfs but i want to know if i can create my flume conf so that i can store values in my hdfs until i find that keyword.
i have a file where certain words are repeating
what i want is that when i put a file using flume spooldir i want to read the contents of file and
store values untill i reach another "MSH". Is it possible using flume ?