Bootstrap broker localhost:9092 (id: -1 rack: null) 与 kafka java 客户端断开连接

时间:2021-07-28 05:25:07

标签: java apache-kafka kafka-producer-api

我尝试在 Windows 10 上制作 kafka 生产者 java 代码。首先,下面是我的 Kafka 生产者代码。

Properties kafkaProdProperty = new Properties();
kafkaProdProperty.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, systemProp.get("kafka.brokerlist"));
kafkaProdProperty.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, StringSerializer.class);
kafkaProdProperty.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG, StringSerializer.class);
kafkaProdProperty.put(ProducerConfig.ACKS_CONFIG, "0");
kafkaProdProperty.put(ProducerConfig.RETRIES_CONFIG, Integer.valueOf(1));
kafkaProdProperty.put(ProducerConfig.BATCH_SIZE_CONFIG, Integer.valueOf(20000));
kafkaProdProperty.put(ProducerConfig.LINGER_MS_CONFIG, Integer.valueOf(1));
kafkaProdProperty.put(ProducerConfig.BUFFER_MEMORY_CONFIG, Integer.valueOf(133554432));

Producer<String, String> kafkaProducer = new KafkaProducer<String, String>(kafkaProdProperty);

String line = //Read from hadoop file system continuously

ProducerRecord<String, String> kafkaProducerRecord = new ProducerRecord<String, String>(topic, line);
kafkaProducer.send(kafkaProducerRecord, new KafkaProducerCallback());

kafka生产者java代码执行成功,无异常。但是来自hadoop的输入行变得越来越长,抛出警告信息如下,

2021-07-27 10:30:28 WARN  NetworkClient:780 - [Producer clientId=producer-8049] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
2021-07-27 10:30:28 WARN  NetworkClient:1077 - [Producer clientId=producer-8049] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected
2021-07-27 10:30:28 WARN  NetworkClient:780 - [Producer clientId=producer-8049] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
2021-07-27 10:30:28 WARN  NetworkClient:1077 - [Producer clientId=producer-8049] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected

我认为这个问题与kafka java资源有关。但我不知道要配置什么。当在 kafka 生产者参数上设置较小的输入行时。它不会像上面那样抛出警告消息。请告诉我如何解决这个问题。最好的问候

0 个答案:

没有答案
相关问题