07-20-2015 09:29 PM
I am trying a solution, in which i have to take files recursively from the folder and perform few calculations and send the required data to output folder.
There is little dependency on the date of the file. I am using multipleoutputs for now, to have that date in file name.
But, it will be very good, if i there is a chance of creating sub folders in the output path with dates and move the respective files into that folder.
One way is to use FileSystem and create required directory and write the file output, without any output from mapreduce.
But, is there a way i can make mapreduce to write into required sub folder.? might not be possible, but just want to give a thought.
07-20-2015 11:05 PM