我一直在使用AIOKafka,直到今天我没有遇到任何问题。
当我尝试使用TypeError
发送邮件时,会出现奇怪的AIOKafkaProducer.send_and_wait
。我还在AIOKafka的github存储库中将此问题发布为问题,但看起来它们有点不活跃。也许在这里有人可以帮助我。
这是代码:
import asyncio
from aiokafka import AIOKafkaConsumer, AIOKafkaProducer
loop = asyncio.get_event_loop()
producer = AIOKafkaProducer(loop=loop, bootstrap_servers="localhost:9092")
async def _initialize(prod, future):
await prod.start()
await prod.send_and_wait("main_topic", str.encode("hello!!"))
future = asyncio.Future()
task = asyncio.ensure_future(_initialize(producer, future))
loop.run_until_complete(task)
print("loop ended!")
loop.close()
这是我收到的错误消息:
yilmazali@yilmazali:~$ python3 aiokafkatest.py
Unexpected error in sender routine
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/aiokafka/producer/producer.py", line 374, in _sender_routine
task.result()
File "/usr/local/lib/python3.6/dist-packages/aiokafka/producer/producer.py", line 418, in _send_produce_req
response = yield from self.client.send(node_id, request)
File "/usr/local/lib/python3.6/dist-packages/aiokafka/client.py", line 415, in send
request, expect_response=expect_response)
File "/usr/local/lib/python3.6/dist-packages/aiokafka/conn.py", line 165, in send
message = header.encode() + request.encode()
File "/usr/local/lib/python3.6/dist-packages/kafka/util.py", line 159, in __call__
return self.method()(self.target(), *args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/struct.py", line 42, in _encode_self
[self.__dict__[name] for name in self.SCHEMA.names]
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 132, in encode
for i, field in enumerate(self.fields)
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 132, in <listcomp>
for i, field in enumerate(self.fields)
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 170, in encode
[self.array_of.encode(item) for item in items]
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 170, in <listcomp>
[self.array_of.encode(item) for item in items]
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 132, in encode
for i, field in enumerate(self.fields)
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 132, in <listcomp>
for i, field in enumerate(self.fields)
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 170, in encode
[self.array_of.encode(item) for item in items]
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 170, in <listcomp>
[self.array_of.encode(item) for item in items]
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 132, in encode
for i, field in enumerate(self.fields)
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 132, in <listcomp>
for i, field in enumerate(self.fields)
File "/usr/local/lib/python3.6/dist-packages/kafka/protocol/types.py", line 93, in encode
return Int32.encode(len(value)) + value
TypeError: object of type '_io.BytesIO' has no len()
我的kafka结构或库没有任何变化。我的卡夫卡经纪人看起来不错。我可以使用shell脚本生成/使用消息。
在过去的2-3个月里,我对AIOKafka没有任何问题,上面的代码运行良好。无处不在,这个错误出现了,我想知道问题是什么。
任何帮助将不胜感激。
最诚挚的问候,
阿里
-
更新:我们在朋友的电脑上运行了这段代码,效果很好。我把我的kafka广告到外面,她用上面的代码成功地写了我当地的kafka主题。两台机器上的AIOKafka库版本均为0.4.0。两台机器上的asyncio版本也是3.4.3。简而言之,问题不在于我的kafka或图书馆。我的机器有问题,但上帝知道具体是什么导致这种情况。
答案 0 :(得分:0)
最后在我的机器上工作了。我只是卸载并安装了 div{
width:100%;
height:100%;
}
模块。
虽然我对这个解决方案不满意,但我想更深入地探究问题的核心,我很高兴我现在可以继续工作了。
希望这有助于遇到同样问题的陌生人。
答案 1 :(得分:0)
您可能已将kafka-python更新为高于1.3.5的版本。我这样做了,aiokafka开始失败了。我在kafka-python 1.3.5返回,看起来没问题