InjectorJob:java.lang.UnsupportedOperationException:未由DistributedFileSystem FileSystem实现实现(gora solr,nutch 2)

时间:2015-03-11 14:32:37

标签: hadoop solr nutch

我需要一些关于apache nutch 2.3.1的帮助。 使用hbase 0.94一切正常,但是当我为solrStore设置时,我得到了这个错误。

InjectorJob: java.lang.UnsupportedOperationException: Not implemented by theDistributedFileSystem FileSystem implementation 
org.apache.hadoop.fs.FileSystem.getScheme(FileSystem.java:214) at 
org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2365) at 
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2375) at 
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2392) at 
org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:89) at 
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2431) at 
org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2413) at 
org.apache.hadoop.fs.FileSystem.get(FileSystem.java:368) at 
org.apache.hadoop.fs.FileSystem.get(FileSystem.java:167) at 
org.apache.hadoop.fs.FileSystem.get(FileSystem.java:352) at 
org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) at 
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(FileInputFormat.java:372) at 
org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:212) at 
org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:252) at 
org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:275) at 
org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at 
org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:284) 

以下是我做的一些步骤

  • solr :将solr 4.8.1与网页架构(无错误)
  • ivy.xml :取消注释的依赖名称=“gora-solr”rev =“0.5”
  • nutch-site.xml :org.apache.gora.solr.store.SolrStore

  • gora.properties

    gora.datastore.default=org.apache.gora.solr.store.SolrStore
    gora.solrstore.solr.url=http://localhost:8983/solr
    gora.solrstore.solr.config=solrconfig.xml
    gora.solrstore.solr.schema=gora-solr-webpage-schema.xml
    gora.solrstore.solr.batchSize=100
    gora.solrstore.solr.solrjserver=http
    gora.solrstore.solr.commitWithin=1000
    gora.solrstore.solr.resultsSize=100
    
  • 蚂蚁运行时

有人设法使用gora solr 0.5和apache nutch 2.3吗?

0 个答案:

没有答案