我正在使用 Google Pub/Sub ruby 客户端来处理发送到多个主题的消息。对于收到的每条消息,我使用 ActiveJob 将其排入队列并确认将其标记为已处理。
subscription.listen do |msg|
Rails.logger.debug("Processing message with id #{msg.message_id}")
MyJob.perform_later(JSON.parse(msg.data))
msg.acknowledge!
Rails.logger.debug("ACKed message with id #{msg.message_id}")
end
但是,通过检查日志,我发现已经被确认的消息正在被一次又一次地处理(参见日志摘录):
2021-05-04 02:15:17.089 EDT "Processing message with id 2260372604401883"
2021-05-04 02:15:17.180 EDT "ACKed message with id 2260372604401883"
2021-05-04 02:17:58.121 EDT "Processing message with id 2260372604401883"
2021-05-04 02:17:58.186 EDT "ACKed message with id 2260372604401883"
2021-05-04 02:20:59.899 EDT "Processing message with id 2260372604401883"
2021-05-04 02:20:59.985 EDT "ACKed message with id 2260372604401883"
2021-05-04 02:22:21.083 EDT "Processing message with id 2260372604401883"
2021-05-04 02:22:21.394 EDT "ACKed message with id 2260372604401883"
2021-05-04 02:24:18.389 EDT "Processing message with id 2260372604401883"
2021-05-04 02:24:18.485 EDT "ACKed message with id 2260372604401883"
2021-05-04 02:25:54.274 EDT "Processing message with id 2260372604401883"
2021-05-04 02:25:54.385 EDT "ACKed message with id 2260372604401883"
2021-05-04 02:26:59.087 EDT "Processing message with id 2260372604401883"
2021-05-04 02:26:59.184 EDT "ACKed message with id 2260372604401883"
Google 报告的未确认消息的数量急剧增加,因此我怀疑 acknowledge!
方法没有按预期运行。
google-cloud-pubsub
版本:2.6.1(最新)答案 0 :(得分:2)
我以前从未见过这个问题,但我可以建议一些尝试:
MyJob.perform_later
返回。这实际上只是一个健全性检查,因为它很可能是默认的 60 秒,但您不妨检查一下。subscriber = subscription.listen do |msg|
# process message
msg.acknowledge!
end
Rails.logger.debug("subscriber ack deadline: #{subscriber.deadline}")
# Register to be notified when unhandled errors occur.
subscriber.on_error do |error|
Rails.logger.error(error.message)
end
config/initializers/grpc_logging.rb
中放置以下内容:module MyLogger
def logger
Rails.logger
end
end
# Define a gRPC module-level logger method before grpc/logconfig.rb loads.
module GRPC
extend MyLogger
end