如何集成apache-nutch-1.9和Hadoop 2.3.0-cdh5.1.0?

时间:2014-08-26 09:19:06

标签: hadoop nutch

我对nutch非常陌生,并尝试将nutch 1.9Hadoop 2.3.0-cdh5.1.0集成,并获得如下所示的例外情况:

Injector: java.lang.UnsupportedOperationException: Not implemented by the DistributedFileSystem FileSystem implementation
        at org.apache.hadoop.fs.FileSystem.getScheme(FileSystem.java:214)
        at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2365)
        at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2375)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:167)
        at org.apache.nutch.crawl.Injector.inject(Injector.java:297)
        at org.apache.nutch.crawl.Injector.run(Injector.java:380)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.nutch.crawl.Injector.main(Injector.java:370)

我对此几乎没有疑问: 我该如何解决这个问题。如果我能将hadoop我正在使用的nutch 1.9版本整合到{{1}},我还有疑问吗?

谢谢, 和Sandeep

0 个答案:

没有答案