Python Kafka生产者无法将json数据发送到cnosumer

时间:2019-10-16 14:24:23

标签: python json apache-kafka

我正在尝试通过python发送数据( input_data ),如下图所示。

[{
  "stateActionTraffic":"1, S1, 1, A1, 20, 0.65
                        1, S1, 2, A2, 20, 0.65
                        1, S1, 3, A3, 20, 0.65
                        2, S2, 1, A1, 25, 0.65
                        2, S2, 2, A2, 25, 0.65
                        2, S2, 3, A3, 25, 0.65"
   "messageType":"split",
   "Id":1232324334
}]

input_data 的基本上数据类型是列表

以下我尝试过的kafka代码是将python(3.x)发送到kafka:

import logging
from kafka.errors import KafkaError
logging.basicConfig(level=logging.INFO)
kafka_brokers=['kafka1-1-stagepf.stage-sin.real.com:9092']
producer = KafkaProducer(bootstrap_servers=kafka_brokers,value_serializer=lambda v: json.dumps(v).encode('utf-8'), api_version=(1,4,6))
producer.send('topic', input_data)
producer.flush()

但是在登录时,我看到在生成以下日志时根本没有发送数据:


INFO:kafka.conn:<BrokerConnection node_id=bootstrap-0 host=kafka1-1-stagepf.stage-sin.real.com:9092 <connecting> [IPv4 ('10.14.27.24', 9092)]>: connecting to kafka1-1-stagepf.stage-sin.real.com:9092 [('10.14.27.24', 9092) IPv4]
INFO:kafka.conn:<BrokerConnection node_id=bootstrap-0 host=kafka1-1-stagepf.stage-sin.real.com:9092 <connecting> [IPv4 ('10.14.27.24', 9092)]>: Connection complete.
INFO:kafka.conn:<BrokerConnection node_id=2 host=10.14.26.71:9092 <connecting> [IPv4 ('10.14.26.71', 9092)]>: connecting to 10.14.26.71:9092 [('10.14.26.71', 9092) IPv4]
INFO:kafka.conn:<BrokerConnection node_id=2 host=10.14.26.71:9092 <connecting> [IPv4 ('10.14.26.71', 9092)]>: Connection complete.
INFO:kafka.conn:<BrokerConnection node_id=bootstrap-0 host=kafka1-1-stagepf.stage-sin.real.com:9092 <connected> [IPv4 ('10.14.27.24', 9092)]>: Closing connection. 
INFO:kafka.conn:<BrokerConnection node_id=bootstrap-0 host=kafka1-1-stagepf.stage-sin.real.com:9092 <connecting> [IPv4 ('10.14.27.24', 9092)]>: connecting to kafka1-1-stagepf.stage-sin.real.com:9092 [('10.14.27.24', 9092) IPv4]
WARNING:kafka.conn:SSL connection closed by server during handshake.
INFO:kafka.conn:<BrokerConnection node_id=bootstrap-0 host=kafka1-1-stagepf.stage-sin.real.com:9092 <handshake> [IPv4 ('10.14.27.24', 9092)]>: Closing connection. KafkaConnectionError: SSL connection closed by server during handshake
INFO:kafka.conn:<BrokerConnection node_id=bootstrap-0 host=kafka1-1-stagepf.stage-sin.real.com:9092 <connecting> [IPv4 ('10.14.27.24', 9092)]>: connecting to kafka1-1-stagepf.stage-sin.real.com:9092 [('10.14.27.24', 9092) IPv4]
WARNING:kafka.conn:SSL connection closed by server during handshake.

因此,正如您从日志文件中看到的那样,没有将数据发送到kafka域的主题,在该日志文件中尝试建立连接然后断开连接。它说连接完成,但随后立即说已断开连接。不知道这里发生了什么。任何帮助将不胜感激。

0 个答案:

没有答案