管道断开后如何修复经纪人可能不可用

时间:2019-07-10 10:13:24

标签: apache-kafka

我通过ssh连接到服务器,启动了zookeper kafka和debezium连接器,过了一会儿,只有kafka终端选项卡被踢出,并出现以下错误 >>>>[2019-07-10 10:04:49,563] WARN [Producer clientId=producer-1] >>>>Connection to node 0 (ip-***.**.**.***.eu- >>>>west-3.compute.internal/***.**.**.***:9092) could not be established. >>>>Broker may not be available. >>>>(org.apache.kafka.clients.NetworkClient:725) >>>>[2019-07-10 10:04:49,676] ERROR WorkerSourceTask{id=mongodb-source- >>>>connector-0} Failed to flush, timed out while waiting for producer to >>>>flush outstanding 8 messages >>>>(org.apache.kafka.connect.runtime.WorkerSourceTask:420) >>>>[2019-07-10 10:04:49,676] ERROR WorkerSourceTask{id=mongodb-source- >>>>connector-0} Failed to commit offsets >>>>(org.apache.kafka.connect.runtime.SourceTaskOffsetCommitter:111)

我的连接器输出是:

$(Release.Artifacts.{$(Release.PrimaryArtifactSourceName)}.DefinitionName)

我不想每次都手动重新启动,如何解决此问题,所以我只能ssh一次启动服务器和连接器然后退出?。

2 个答案:

答案 0 :(得分:0)

两个选项:

  1. 将流程作为服务启动(ref
  2. 使用诸如screen或tmux之类的工具,以便即使关闭连接后会话仍会持续。

选项(1)是生产中的操作方式。选项(2)在开发,使用VPN,断开连接/重新连接等时非常方便-因为该过程不仅可以继续运行,而且还可以像断开连接时一样重新连接到会话。下面是一个示例及其用法:https://www.rittmanmead.com/blog/2012/05/screen-and-obiee/

答案 1 :(得分:0)

好吧,我所做的就是  sudo systemctl启用confluent-zookeeper sudo systemctl启用合流卡夫卡 sudo systemctl启动融合动物 我遇到了文件错误acces,已将其更改为chmod,现在zookeeper正常工作。 须藤systemctl启动汇合卡夫卡 我仍然无法解决错误,这是输出

at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.j
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:335)
at org.apache.kafka.common.record.FileRecords.openChannel(FileRecords.java:4
at org.apache.kafka.common.record.FileRecords.open(FileRecords.java:410)
at org.apache.kafka.common.record.FileRecords.open(FileRecords.java:419)