用于消费的python kafka不起作用

时间:2015-07-04 03:51:39

标签: python apache-kafka kafka-python

我可以写信给kafka。但是,消费不起作用

kafka = KafkaClient(kafka_host_list)
consumer = SimpleConsumer(kafka,'topic-test-development','topic-test-development')

No handlers could be found for logger "kafka.conn"
Traceback (most recent call last):
  File "/home/ubuntu/workspace/feed-tests/tests/kafka_consumer.py", line 44, in <module>
    consumer = SimpleConsumer(kafka,'topic-test-development','topic-test-development')
  File "/usr/local/lib/python2.7/dist-packages/kafka/consumer/simple.py", line 126, in __init__
    auto_commit_every_t=auto_commit_every_t)
  File "/usr/local/lib/python2.7/dist-packages/kafka/consumer/base.py", line 75, in __init__
    self.fetch_last_known_offsets(partitions)
  File "/usr/local/lib/python2.7/dist-packages/kafka/consumer/base.py", line 101, in fetch_last_known_offsets
    check_error(resp)
  File "/usr/local/lib/python2.7/dist-packages/kafka/common.py", line 230, in check_error
    raise response
kafka.common.FailedPayloadsError

1 个答案:

答案 0 :(得分:2)

注意No handlers could be found for logger "kafka.conn"

为记录器添加代码:

logging.basicConfig(
    format='%(asctime)s.%(msecs)s:%(name)s:%(thread)d:%(levelname)s:%(process)d:%(message)s',
    level=logging.DEBUG
)

运行并输出更多信息

2015-07-13 15:26:32,158.158.830881119:kafka.conn:140247909795584:DEBUG:17035:为host01重新初始化套接字连接:9092 2015-07-13 15:26:32,221.221.35591507:kafka.conn:140247909795584:ERROR:17035:无法连接到kafka经纪人 host01:9092