Kafka Connect-弹性搜索-将ROWTIME发布到弹性搜索

时间:2020-06-18 22:46:53

标签: elasticsearch apache-kafka apache-kafka-connect

我正在尝试将数据从kafka主题发布到Elastic搜索。我能够将所有数据发布到ES。但是无法将ROWTIME发布到ES。

{
  "name": "elasticsearch_sink",
  "config": {
    "connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",
    "tasks.max": "1",
    "topics": "k-connect-status",
    "connection.url": "http://docker.for.mac.host.internal:9200",
    "type.name": "connectstatus",
    "value.converter": "org.apache.kafka.connect.json.JsonConverter", 
    "key.converter": "org.apache.kafka.connect.storage.StringConverter",
    "validate.non.null": "false",
    "key.ignore":"false",
    "schema.ignore":"true",
    "value.converter.schemas.enable": "false"
  }
}

主题中的JSON数据

{
  "ROWTIME":1591743374742,
  "ROWKEY":"status-connector-elasticsearch_sink_31",
  "state":"RUNNING",
  "trace":null,
  "worker_id":"connect:8083",
  "generation":2
}

弹性搜索输出

{
  "_index" : "k-connect-status",
  "_type" : "connectstatus",
  "_id" : "status-connector-elasticsearch_sink_31",
  "_score" : 1.0,
  "_source" : {
    "generation" : 2,
    "trace" : null,
    "state" : "RUNNING",
    "worker_id" : "connect:8083"
  }
}

是否可以将 ROWTIME 发布到Elastic Search。

0 个答案:

没有答案