Question

一个Kafka节点被破坏后，新的Kafka代理无法加入集群，并且每次重新启动后，我都会在其日志中看到以下消息：

[2019-03-13 13:52:11,673] ERROR [ReplicaFetcher replicaId=1016, leaderId=1004, fetcherId=2] Error due to (kafka.server.ReplicaFetcherThread)
kafka.common.KafkaException: Error processing data for partition log.system-11 offset 161122487
        at kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$7(AbstractFetcherThread.scala:205)
        at scala.Option.foreach(Option.scala:257)
        at kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$6(AbstractFetcherThread.scala:172)
        at kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$6$adapted(AbstractFetcherThread.scala:169)
        at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:59)
        at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:52)
        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
        at kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$5(AbstractFetcherThread.scala:169)
        at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
        at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:217)
        at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:169)
        at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
        at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
Caused by: java.lang.IllegalArgumentException: Out of order offsets found in List(161122487, 
...
)
        at kafka.log.Log.$anonfun$append$2(Log.scala:683)
        at kafka.log.Log.maybeHandleIOException(Log.scala:1669)
        at kafka.log.Log.append(Log.scala:624)
        at kafka.log.Log.appendAsFollower(Log.scala:607)
        at kafka.server.ReplicaFetcherThread.processPartitionData(ReplicaFetcherThread.scala:102)
        at kafka.server.ReplicaFetcherThread.processPartitionData(ReplicaFetcherThread.scala:41)
        at kafka.server.AbstractFetcherThread.$anonfun$processFetchRequest$7(AbstractFetcherThread.scala:184)
        ... 12 more

出现问题后，我看到多个消息，例如：

[2019-03-13 13:52:11,792] INFO [ReplicaFetcherManager on broker 1016] Removed fetcher for partitions  (kafka.server.ReplicaFetcherManager)
[2019-03-13 13:52:11,793] INFO [ReplicaFetcherManager on broker 1016] Added fetcher for partitions List() (kafka.server.ReplicaFetcherManager)

该怎么办，可以解决吗？幸运的是，我并不真正在乎此群集上的数据，但是整个情况使我担心可能的生产故障。

这是什么意思？在Kafka中，“原因：java.lang.IllegalArgumentException：列表中发现的乱序偏移量”是什么？

0 个答案: