我正在使用OpaqueTridentKafkaSpout风暴。然而,在提交之后,喷口的并行性是一个。
BrokerHosts zk = new ZkHosts("xxx.xxx.xxx.xxx");
TridentKafkaConfig spoutConf = new TridentKafkaConfig(zk, "xx","xxx");
spoutConf.scheme = new SchemeAsMultiScheme(new StringScheme());
OpaqueTridentKafkaSpout dataSpout = new OpaqueTridentKafkaSpout(spoutConf);
所有配置参数都在跟随。
Config conf = new Config();
conf.setDebug(false);
conf.setNumWorkers(100);
conf.setNumAckers(200);
conf.setMaxTaskParallelism(200);
conf.setMaxSpoutPending(500);
我该怎么办?非常感谢!
使用2016-01-22 11:00:00更新
我尝试将添加喷口类型更改为
`OpaqueTridentKafkaSpout dataSpout1 = new OpaqueTridentKafkaSpout(spoutConf);
OpaqueTridentKafkaSpout dataSpout2 = new OpaqueTridentKafkaSpout(spoutConf);
TridentTopology topology = new TridentTopology();
Stream stream1 = topology.newStream("dataSpout1",dataSpout1).name("dataSpout1");
Stream stream2 = topology.newStream("dataSpout2",dataSpout2).name("dataSpout2");
Stream stream = topology.merge(stream1,stream2);`
也失败了......