Question

每当我尝试重新启动kafka时，都会出现以下错误。一旦我删除/ tmp / kafka-logs，它就会得到解决，但同时也会删除我的主题。有办法解决吗？

     ERROR Error while deleting the clean shutdown file in dir /tmp/kafka-logs (kafka.server.LogDirFailureChannel)
java.io.IOException: Invalid argument
        at java.io.RandomAccessFile.setLength(Native Method)
        at kafka.log.AbstractIndex$$anonfun$resize$1.apply$mcZ$sp(AbstractIndex.scala:128)
        at kafka.log.AbstractIndex$$anonfun$resize$1.apply(AbstractIndex.scala:115)
        at kafka.log.AbstractIndex$$anonfun$resize$1.apply(AbstractIndex.scala:115)
        at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:251)
        at kafka.log.AbstractIndex.resize(AbstractIndex.scala:115)
        at kafka.log.AbstractIndex$$anonfun$trimToValidSize$1.apply$mcZ$sp(AbstractIndex.scala:184)
        at kafka.log.AbstractIndex$$anonfun$trimToValidSize$1.apply(AbstractIndex.scala:184)
  kafka.log.LogManager.kafka$log$LogManager$$loadLog(LogManager.scala:265)
        at kafka.log.LogManager$$anonfun$loadLogs$2$$anonfun$11$$anonfun$apply$15$$anonfun$apply$2.apply$mcV$sp(LogManager.scala:345)
        at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:63)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
[2018-11-02 16:00:07,126] INFO Logs loading complete in 4323 ms. (kafka.log.LogManager)
[2018-11-02 16:00:07,134] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)
[2018-11-02 16:00:07,136] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager)
[2018-11-02 16:00:07,388] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)
[2018-11-02 16:00:07,414] INFO [SocketServer brokerId=0] Started 1 acceptor threads (kafka.network.SocketServer)
[2018-11-02 16:00:07,430] INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2018-11-02 16:00:07,430] INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2018-11-02 16:00:07,432] INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2018-11-02 16:00:07,452] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler)
[2018-11-02 16:00:07,453] INFO [ReplicaManager broker=0] Stopping serving replicas in dir /tmp/kafka-logs (kafka.server.ReplicaManager)
[2018-11-02 16:00:07,456] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions  (kafka.server.ReplicaFetcherManager)
[2018-11-02 16:00:07,458] INFO [ReplicaAlterLogDirsManager on broker 0] Removed fetcher for partitions  (kafka.server.ReplicaAlterLogDirsManager)
[2018-11-02 16:00:07,461] INFO [ReplicaManager broker=0] Broker 0 stopped fetcher for partitions  and stopped moving logs for partitions  because they are in the failed log directory /tmp/kafka-logs. (kafka.server.ReplicaManager)
[2018-11-02 16:00:07,462] INFO Stopping serving logs in dir /tmp/kafka-logs (kafka.log.LogManager)
[2018-11-02 16:00:07,465] ERROR Shutdown broker because all log dirs in /tmp/kafka-logs have failed (kafka.log.LogManager)

有什么我想念的吗？

Answer 1

正如评论中提到的，前进的方向似乎是将日志位置移出 /tmp。

我还记得在某处看到将所有权更改为 hadoop.hadoop 可能会有所帮助，但我自己从未尝试过。

KAFKA重新启动问题：无法在不删除/ tmp / kafka-logs的情况下重新启动kafka

1 个答案: