Reply
Contributor
Posts: 55
Registered: ‎09-17-2013

Recursive Input with Path Filter is throwing error

Hi,

 

I am setting the recrusive file read in InputFormat.

 

I have tried to use PathFilter now, which is throwing error as

 

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:

 

 

Code

FileInputFormat.setInputPathFilter(job, JobPathFilter.class);
        
         try {
            FileInputFormat.addInputPath(job, new Path(inputs[0]));
        } catch (IllegalArgumentException | IOException e) {
            throw new Exception("Input Path provided is not correct, please verify", e);
        }

 

FileInputFormat.setInputDirRecursive(job, true);

 

When i ran the job without filter, it is working. i think it is due to filter only, what might have gone wrong.?

Highlighted
Posts: 1,836
Kudos: 415
Solutions: 295
Registered: ‎07-31-2013

Re: Recursive Input with Path Filter is throwing error

What is the implementation of your JobPathFilter class?
Announcements