我正在使用docker-secor将消息从kafka主题获取到Google云存储。该应用程序似乎正常启动,并为主题创建了所有消费者和观察者。但随后失败并显示下一条消息:
2019-08-23 10:45:15,739 [raw_logs_app01-wk003.scrapinghub.com_32_30-leader-finder-thread] (kafka.utils.Logging$class:89) WARN [raw_logs_app01-wk003.scrapinghub.com_32_30-leader-finder-thread], Failed to find leader for Set([filebeat_crawlera_requests,13], [filebeat_crawlera_requests,14], [filebeat_crawlera_requests,12], [filebeat_crawlera_requests,15])
kafka.common.BrokerEndPointNotAvailableException: End point with security protocol PLAINTEXT not found for broker 1133
at kafka.cluster.Broker$$anonfun$5.apply(Broker.scala:131)
at kafka.cluster.Broker$$anonfun$5.apply(Broker.scala:131)
at scala.collection.MapLike$class.getOrElse(MapLike.scala:128)
at scala.collection.AbstractMap.getOrElse(Map.scala:58)
at kafka.cluster.Broker.getBrokerEndPoint(Broker.scala:130)
at kafka.utils.ZkUtils$$anonfun$getAllBrokerEndPointsForChannel$1.apply(ZkUtils.scala:166)
at kafka.utils.ZkUtils$$anonfun$getAllBrokerEndPointsForChannel$1.apply(ZkUtils.scala:166)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
at scala.collection.AbstractTraversable.map(Traversable.scala:105)
at kafka.utils.ZkUtils.getAllBrokerEndPointsForChannel(ZkUtils.scala:166)
at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:65)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
任何人都可以解释“ kafka.common.BrokerEndPointNotAvailableException:未为代理1133找到具有安全协议PLAINTEXT的端点”的含义,并且急于解决它吗?
为什么使用PLAINTEXT?我设置了以下选项:
kafka.new.consumer.secur
ity.protocol=SSL
security.protocol=SSL
security.inter.broker.protocol=SSL
zookeeper.sasl.client=false