Support Questions
Find answers, ask questions, and share your expertise

Run Nutch 1.x with HDFS

Run Nutch 1.x with HDFS

New Contributor

I have this problem with CDH 6.3.2, Nutch 1.x

I use this command : /etc/nutch/runtime/deploy -i crawl 2

And the result is:

 

20/11/18 14:41:19 ERROR crawl.Generator: Generator: org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "hdfs"
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3215)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3235)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:123)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3286)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3254)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:478)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:462)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361)
at org.apache.nutch.crawl.Generator.generate(Generator.java:758)
at org.apache.nutch.crawl.Generator.run(Generator.java:1051)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.nutch.crawl.Generator.main(Generator.java:998)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:313)
at org.apache.hadoop.util.RunJar.main(RunJar.java:227)