org.apache.kafka.common.errors.TimeoutException:TopicJAVA-0的119条记录已过期:自批处理创建以来,经过了60030 ms的时间

时间:2018-11-30 13:37:59

标签: java timeout kafka-producer-api

这是我的代码和依赖关系。我正在尝试使用Producer API将消息写入KAfka。并且,尽管没有将消息发送到Kafka主题,但也创建了该主题,但以下异常

org.apache.kafka.common.errors.TimeoutException:TopicJAVA-0的119条记录已过期:自批处理创建以来已经过了60049 ms。

public static void main(String[] args) throws Exception {

     Map<String,Object> map=new HashMap<String, Object>();
        map.put("bootstrap.servers","10.1.7.82:6667");
        map.put("key.serializer","org.apache.kafka.common.serialization.StringSerializer");
        map.put("value.serializer","org.apache.kafka.common.serialization.StringSerializer");
        map.put("metadata.fetch.timeout.ms", "60000");
        map.put("request.timeout.ms", "60000");
        map.put("batch.size",16384);
        map.put("buffer.memory", 33554432);

    KafkaProducer<String, String> producer = new KafkaProducer<String, String>(map);
    // Write
        // create the topic message, enter topic name and message
        ProducerRecord<String, String> record = new ProducerRecord<String, String>("TopicJAVA", "msg from java");
        // function to push the message to kafka topic
        RecordMetadata meta=producer.send(record).get();
        System.out.println("Message Sent"+meta.partition());
        Thread.sleep(500);
        producer.close();

}

这是我的依赖项POM

http://maven.apache.org/xsd/maven-4.0.0.xsd“>     4.0.0

<groupId>com.gaurav.kafka</groupId>
<artifactId>kakfa-producer-consumer-example</artifactId>
<version>0.0.1-SNAPSHOT</version>
<packaging>jar</packaging>

<name>kakfa-producer-consumer-example</name>
<url>http://maven.apache.org</url>

<properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
</properties>

<dependencies>
    <!-- https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients -->
    <!-- <dependency>
        <groupId>org.apache.kafka</groupId>
        <artifactId>kafka-clients</artifactId>
        <version>1.1.0</version>
    </dependency> -->

    <!-- Ashok Kafka Dependencies -->


    <dependency>
        <groupId>org.slf4j</groupId>
        <artifactId>slf4j-log4j12</artifactId>
        <version>1.7.5</version>
    </dependency>
    <dependency>
        <groupId>org.apache.kafka</groupId>
        <artifactId>kafka_2.10</artifactId>
        <version>0.8.2.2</version>
    </dependency>
<dependency>
    <groupId>org.apache.kafka</groupId>
    <artifactId>kafka-clients</artifactId>
    <version>0.10.2.1</version>
</dependency>
    <dependency>
        <groupId>com.101tec</groupId>
        <artifactId>zkclient</artifactId>
        <version>0.7</version>
    </dependency>



    <!-- https://mvnrepository.com/artifact/com.fasterxml.jackson.core/jackson-databind -->
    <dependency>
        <groupId>com.fasterxml.jackson.core</groupId>
        <artifactId>jackson-databind</artifactId>
        <version>2.9.5</version>
    </dependency>


</dependencies>

我绝对不知道这里缺少什么,了解这一点真的很有帮助。我们的kafka版本是10.1.2.6.4.0-91 M尝试解决了过去3天的问题,但感到无助

0 个答案:

没有答案