Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Recursive Input with Path Filter is throwing error

Recursive Input with Path Filter is throwing error

Explorer

Hi,

 

I am setting the recrusive file read in InputFormat.

 

I have tried to use PathFilter now, which is throwing error as

 

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:

 

 

Code

FileInputFormat.setInputPathFilter(job, JobPathFilter.class);
        
         try {
            FileInputFormat.addInputPath(job, new Path(inputs[0]));
        } catch (IllegalArgumentException | IOException e) {
            throw new Exception("Input Path provided is not correct, please verify", e);
        }

 

FileInputFormat.setInputDirRecursive(job, true);

 

When i ran the job without filter, it is working. i think it is due to filter only, what might have gone wrong.?

1 REPLY 1
Highlighted

Re: Recursive Input with Path Filter is throwing error

Master Guru
What is the implementation of your JobPathFilter class?