在集群模式下提交后,OpaqueTridentKafkaSpout的并行性是一个

时间:2016-01-20 11:31:29

标签: apache-kafka apache-storm

我正在使用OpaqueTridentKafkaSpout风暴。然而,在提交之后,喷口的并行性是一个。

    BrokerHosts zk = new ZkHosts("xxx.xxx.xxx.xxx");
    TridentKafkaConfig spoutConf = new TridentKafkaConfig(zk, "xx","xxx");
    spoutConf.scheme = new SchemeAsMultiScheme(new StringScheme());
    OpaqueTridentKafkaSpout dataSpout = new OpaqueTridentKafkaSpout(spoutConf);

enter image description here

所有配置参数都在跟随。

Config conf = new Config();
    conf.setDebug(false);
    conf.setNumWorkers(100);
    conf.setNumAckers(200);
    conf.setMaxTaskParallelism(200);
    conf.setMaxSpoutPending(500);

我该怎么办?非常感谢!

使用2016-01-22 11:00:00更新

我尝试将添加喷口类型更改为

   `OpaqueTridentKafkaSpout dataSpout1 = new OpaqueTridentKafkaSpout(spoutConf);
    OpaqueTridentKafkaSpout dataSpout2 = new OpaqueTridentKafkaSpout(spoutConf);
    TridentTopology topology = new TridentTopology();
    Stream stream1 = topology.newStream("dataSpout1",dataSpout1).name("dataSpout1");
    Stream stream2 = topology.newStream("dataSpout2",dataSpout2).name("dataSpout2");
    Stream stream =  topology.merge(stream1,stream2);`

也失败了......

0 个答案:

没有答案