https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-make-Spooling-Directory-Source-work-with-sub/m-p/30929#M7053 <P><SPAN>How to make Flume Spooling Directory Source work with the Sub Directories of a folder too. My source folder have several other folders too, I want my flume agent to look into these sub directories too for a file to dump it into sink. Is there any way to do it?</SPAN></P> Fri, 16 Sep 2022 09:38:18 GMT Dhruv 2022-09-16T09:38:18Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-make-Spooling-Directory-Source-work-with-sub/m-p/30929#M7053 <P><SPAN>How to make Flume Spooling Directory Source work with the Sub Directories of a folder too. My source folder have several other folders too, I want my flume agent to look into these sub directories too for a file to dump it into sink. Is there any way to do it?</SPAN></P> Fri, 16 Sep 2022 09:38:18 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-make-Spooling-Directory-Source-work-with-sub/m-p/30929#M7053 Dhruv 2022-09-16T09:38:18Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-make-Spooling-Directory-Source-work-with-sub/m-p/31082#M7054 <P>You can create multiple agent sources that point to different sub-directories on the server I believe.&nbsp; Check out the <A href="http://flume.apache.org/FlumeUserGuide.html" target="_self">Flume User Guide</A>&nbsp;and search for "Adding multiple flows in an agent" to see if that helps?&nbsp; There's likely even more applicable information for you beyond that section as well.</P><P>&nbsp;</P><P>It also sounds like you <U>may</U> be wanting dynamic&nbsp;recursive directory searching for Flume... I don't know if that's available right now (I don't think it is),&nbsp;but I would be interested if someone knows one way or the other. <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span></P> Sun, 23 Aug 2015 03:42:25 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-make-Spooling-Directory-Source-work-with-sub/m-p/31082#M7054 tseader 2015-08-23T03:42:25Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-make-Spooling-Directory-Source-work-with-sub/m-p/31288#M7055 <P>There is a patch available FLume-1899, if any body wants he/she can use that for Recursive Directory Search.</P> Thu, 27 Aug 2015 08:01:56 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-to-make-Spooling-Directory-Source-work-with-sub/m-p/31288#M7055 Dhruv 2015-08-27T08:01:56Z