Question

我在Windows上设置了带有solr（4.4.0）的nutch（1.4），并抓取了教程中提到的nutch默认页面。但是，在爬网成功后，我无法使用命令“ bin / nutch solrindex http://xxx.xxx.xxx.xxx:8080/solr/ crawl / crawldb -linkdb crawl / linkdb crawl / segments / * ”将页面添加到索引中

以下是hadoop日志的摘录。非常感谢任何帮助。

2013-09-13 14:50:24,137 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.basic.BasicIndexingFilter
2013-09-13 14:50:24,137 INFO  anchor.AnchorIndexingFilter - Anchor deduplication is: off
2013-09-13 14:50:24,137 INFO  indexer.IndexingFilters - Adding org.apache.nutch.indexer.anchor.AnchorIndexingFilter
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: content dest: content
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: site dest: site
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: title dest: title
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: host dest: host
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: segment dest: segment
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: boost dest: boost
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: digest dest: digest
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: tstamp dest: tstamp
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: url dest: id
2013-09-13 14:50:24,215 INFO  solr.SolrMappingReader - source: url dest: url
2013-09-13 14:50:24,277 INFO  solr.SolrWriter - Adding 11 documents
2013-09-13 14:50:24,511 WARN  mapred.LocalJobRunner - job_local_0001
org.apache.solr.common.SolrException: Internal Server Error

Internal Server Error

request: http://xxx.xxx.xxx.xxx:8080/solr/update?wt=javabin&version=2
    at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:430)
    at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244)
    at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
    at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:49)
    at org.apache.nutch.indexer.solr.SolrWriter.close(SolrWriter.java:93)
    at org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.java:48)
    at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:474)
    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
2013-09-13 14:50:25,229 ERROR solr.SolrIndexer - java.io.IOException: Job failed!

Answer 1

有了这些信息，我想你忘了运行Solr，或者你没有得到nutch的访问权限！您是否可以在浏览器中访问http://xxx.xxx.xxx.xxx:8080/solr/？

无法将索引文件添加到来自nutch的solr

1 个答案: