我是Kafka的新手,正在研究Kafka Mqtt源连接器。我正在用2个不同的示例来实现Mqtt源连接器。
请检查以下详细信息。
参考文献1:https://johanvandevenne.github.io/kafka-connect-mqtt/
Kafka Mqtt源连接器
http://localhost:8083/connectors \
-H 'Content-Type: application/json' \
-d '{ "name": "mqtt-source-connector",
"config":
{
"connector.class":"be.jovacon.kafka.connect.MQTTSourceConnector",
"mqtt.topic":"temperature",
"kafka.topic":"mqtt.",
"mqtt.clientID":"my_client_id",
"mqtt.broker":"tcp://127.0.0.1:1883",
"key.converter":"org.apache.kafka.connect.storage.StringConverter",
"key.converter.schemas.enable":false,
"value.converter":"org.apache.kafka.connect.storage.StringConverter",
"value.converter.schemas.enable":false
}
}'
curl -s -X POST -H 'Content-Type: application/json' http://localhost:8083/connectors -d '{
"name" : "mqtt-source",
"config" : {
"connector.class" : "io.confluent.connect.mqtt.MqttSourceConnector",
"tasks.max" : "1",
"mqtt.server.uri" : "tcp://127.0.0.1:1883",
"mqtt.topics" : "temperature",
"kafka.topic" : "mqtt.",
"confluent.topic.bootstrap.servers": "localhost:9092",
"confluent.topic.replication.factor": "1",
"confluent.license":""
}
}'
当我执行上述示例并检查连接器状态时,它显示出我的运行方式:
curl http:// localhost:8083 / connectors / mqtt-source / status | python -m json.tool
%总接收百分比%Xferd平均速度时间时间时间 当前 Dload上传总剩余左行驶速度100185100185 0 0 10277 0-:-:--:-:- -:-:-10277 { “连接器”:{ “ state”:“ RUNNING”, “ worker_id”:“ 127.0.1.1:8083” }, “ name”:“ mqtt-source”, “任务”: [ { “ id”:0, “ state”:“ RUNNING”, “ worker_id”:“ 127.0.1.1:8083” } ], “ type”:“源”}
但是,当我从Mqtt主题发布数据时,在kafka消费者主题中却没有收到。
消费者:kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic mqtt。 --from-beginning
Mqtt发布主题:mosquitto_pub -h 127.0.0.1 -p 1883 -t温度 -q 2 -m“ 99999,2.10#”
当我从Mqtt发布数据时,两个Kafka Mqtt连接器都给我以下错误:
{ “连接器”:{ “ state”:“ RUNNING”, “ worker_id”:“ 127.0.1.1:8083” }, “ name”:“ mqtt-source”, “任务”: [ { “ id”:0, “ state”:“ FAILED”, “ trace”:“ java.lang.NullPointerException \ n \ tat org.apache.kafka.connect.runtime.WorkerSourceTask.convertHeaderFor(WorkerSourceTask.java:296)\ n org.apache.kafka.connect.runtime.WorkerSourceTask.sendRecords(WorkerSourceTask.java:226)\ n \ tat org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:194)\ n \ tat org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:170)\ n \ tat org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:214)\ n \ tat java.base / java.util.concurrent.Executors $ RunnableAdapter.call(Executors.java:515)\ n \ tat java.base / java.util.concurrent.FutureTask.run(FutureTask.java:264)\ n \ tat java.base / java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\ n \ tat java.base / java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:628)\ n \ tat java.base / java.lang.Thread.run(Thread.java:834)\ n“, “ worker_id”:“ 127.0.1.1:8083” } ], “ type”:“源”}
连接器属性是否存在问题?还是其他的东西??
预先感谢