Question

就像下面的代码一样，我不断从azure eventhub接收数据。我经常看到错误消息：“超出了每个分区允许的最大接收器数量”，我知道它来自哪里。

import os
import sys
import logging
import time
from azure.eventhub import EventHubClient, Receiver, Offset

logger = logging.getLogger("azure")

ADDRESS = ""
USER = ""
KEY = ""

CONSUMER_GROUP = "$default"
OFFSET = Offset("@latest")
PARTITION = "0"

total = 0
last_sn = -1
last_offset = "-1"
client = EventHubClient(ADDRESS, debug=False, username=USER, password=KEY)

receiver = client.add_receiver(CONSUMER_GROUP, PARTITION, prefetch=0, offset=OFFSET)    
client.run()
start_time = time.time()
while True:
    for event_data in receiver.receive(timeout=5000):
        print("Received: {}".format(event_data.body_as_str(encoding='UTF-8')))
        a = event_data.body_as_str(encoding='UTF-8')
        total += 1
    end_time = time.time()
    run_time = end_time - start_time
    print("Received {} messages in {} seconds".format(total, run_time))

这里的行是添加接收者的那一行，如果我添加了五个以上的接收者，它将达到每个分区可能的接收者数量的限制。

receiver = client.add_receiver(CONSUMER_GROUP, PARTITION, prefetch=0

因此，我尝试删除带有功能的接收器。例如使用receiver.client.clients.remove或receiver.client.clients.clear()清除之前添加的接收者。但是，这些方法似乎都不起作用。

我看到此错误的原因是，因为每当我需要停止运行脚本进行调试时都运行上面的全部代码，因此每当我重新运行它时，都必须运行receiver = client.add_receiver(CONSUMER_GROUP, PARTITION, prefetch=0行

我还尝试只运行“ add_receiver”行下方的部分代码

client.run()
start_time = time.time()
while True:
    for event_data in receiver.receive(timeout=5000):
        print("Received: {}".format(event_data.body_as_str(encoding='UTF-8')))
        a = event_data.body_as_str(encoding='UTF-8')
        total += 1
    end_time = time.time()
    run_time = end_time - start_time
    print("Received {} messages in {} seconds".format(total, run_time))

但是，我看到另一个错误，说EventHubError: This receive handler is now closed.

有什么方法可以解决此问题？

Answer 1

经过努力，我认为这可能是解决此问题的方法。

对于上面的第22行，我可以简单地向其中添加“ keep_alive”输入，例如：

receiver = client.add_receiver(CONSUMER_GROUP, PARTITION, prefetch=0, offset=OFFSET, keep_alive = 10000000)

这样，我可以使客户端接收器保持打开状态，而不会收到错误消息“ EventHubError：此接收处理程序现在已关闭。”，然后只需从下面运行唯一的部分即可：

start_time = time.time()
while True:
    for event_data in receiver.receive(timeout=5000):
        print("Received: {}".format(event_data.body_as_str(encoding='UTF-8')))
        a = event_data.body_as_str(encoding='UTF-8')
        total += 1
    end_time = time.time()
    run_time = end_time - start_time
    print("Received {} messages in {} seconds".format(total, run_time))

超出每个分区允许的最大接收器数量eventhub中的错误

1 个答案: