@Shu I have implemented your template but the merged result is not in the order what I need in the simulation setting, I have five files, which is 00000_0 contains 'aaa' 00001_0 contains 'bbb' 00002_0 contains 'ccc' 00003_0 contains 'eee' 00004_0 contains 'hhhh' I want the output to be: aaa; bbb; ccc; eee; hhhh but the actual output is : eee; bbb; hhhh; ccc; aaa It seems that list/fetch processor can't detect the order like get processor? result.jpg ... View more

@Shu I have tried the setting as you mentioned and the processor of fetchHDFS is with input flow but there is no output flow... (I have waited for several minutes) could you help me to take a look of my setting flow flow.jpg listHDFS listhdfs.jpg fetchHDFS fetchhdfs.jpg Thanks for your lots of helping ... View more

@Shu Yes, I add a RouteonAttribute processor to filter some file that I need but, the question is that I don't know how to fill the expression language for fetchHDFS I have tried this one but it doesn't work...filetofetch.jpg ... View more

@Shu I have tried the method 1 as you suggested. The overall flow is ListHDFS→ RouteonAttribute→ FetchHDFS→ MergeContent→PutSFTP I try to use 'RouteonAttribute' as a filter and I add a new property which is filetofetch and I fill it with '${filename:contains('000')}' But the question is how to fill the HDFS Filename in the processor of FetchHDFS? ... View more

Here is flow (flow.jpg): flow.jpg it can be divided into two parts: 1. First part (above) is doing some Hive like language to generate some files. Please refer to result.jpg for a look result.jpg 2. Second part (bottom) is doing merge process and send the final data to SFTP. But the original data is divided into several parts. If I do MergeContent processor with Bin-Packing Algorithm, it will merge the file with the order like 1→0→2, however, I want it in the order of 0→1→2 How can I achieve this propose? ... View more