Kafka - 到 - HDFS / Connect-Avro-Standalone.properties

时间:2017-06-06 06:58:14

标签: hadoop apache-kafka hdfs apache-kafka-connect

我想连接日志文件kafka并将其作为.avro文件移动到hdfs。但我还没有决定应该使用哪个转换器。我该如何组织这个文件?

confluent-3.2.1 /etc/schema-registry/connect-avro-standalone.properties

bootstrap.servers=localhost:9092

key.converter=io.confluent.connect.avro.AvroConverter
key.converter=org.apache.kafka.connect.storage.StringConverter
key.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schema.registry.url=http://localhost:8081


value.converter=io.confluent.connect.avro.AvroConverter
value.converter.schema.registry.url=http://localhost:8081


internal.key.converter=org.apache.kafka.connect.json.JsonConverter
internal.value.converter=org.apache.kafka.connect.json.JsonConverter

internal.key.converter=org.apache.kafka.connect.storage.StringConverter
internal.value.converter=org.apache.kafka.connect.storage.StringConverter

internal.key.converter.schemas.enable=true
internal.value.converter.schemas.enable=true

0 个答案:

没有答案