StormCrawler从1.6移动到1.8

时间:2018-04-18 07:36:43

标签: web-crawler stormcrawler

我在尝试切换到SC 1.8时遇到以下错误(之前我在1.6上)。我按照推荐安装了Storm 1.2.1,ES 6.2.2,改编了ES配置和我的ES种子注入器拓扑。但是,当我启动它时,我得到的是:

4845 [Thread-34-enqueue-executor[5 5]] ERROR c.d.s.e.p.StatusUpdaterBolt - Can't connect to ElasticSearch
java.lang.IllegalArgumentException: no hosts provided
        at org.elasticsearch.client.RestClientBuilder.<init>(RestClientBuilder.java:69) ~[patent-crawler-1.8.jar:?]
        at org.elasticsearch.client.RestClient.builder(RestClient.java:120) ~[patent-crawler-1.8.jar:?]
        at com.digitalpebble.stormcrawler.elasticsearch.ElasticSearchConnection.getClient(ElasticSearchConnection.java:96) ~[patent-crawler-1.8.jar:?]
        at com.digitalpebble.stormcrawler.elasticsearch.ElasticSearchConnection.getConnection(ElasticSearchConnection.java:166) ~[patent-crawler-1.8.jar:?]
        at com.digitalpebble.stormcrawler.elasticsearch.persistence.StatusUpdaterBolt.prepare(StatusUpdaterBolt.java:141) [patent-crawler-1.8.jar:?]
        at org.apache.storm.daemon.executor$fn__5043$fn__5056.invoke(executor.clj:803) [storm-core-1.2.1.jar:1.2.1]
        at org.apache.storm.util$async_loop$fn__557.invoke(util.clj:482) [storm-core-1.2.1.jar:1.2.1]
        at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]

有没有人遇到过类似的问题? 谢谢!

2 个答案:

答案 0 :(得分:1)

抱歉,我的错误,我的ES yaml复制/粘贴太快了。我为所有索引复制了索引器条目(es.indexer.addresses)... 现在它工作正常。 谢谢朱利安的暗示!

答案 1 :(得分:0)

es.status.addresses 的配置中有什么?旧值应兼容