汇流Kafka S3连接器无法上传到S3

时间:2017-05-18 08:15:40

标签: amazon-web-services amazon-s3 apache-kafka apache-kafka-connect confluent

我试图按照此链接http://docs.confluent.io/current/connect/connect-storage-cloud/kafka-connect-s3/docs/s3_connector.html#quickstart

中的教程进行操作

我设法创建主题并键入数据。但是,当我尝试上传到S3时,显然一切都运行正常,终端输出没有任何错误,但我的存储桶仍然是空的。以下是输出的最后几行。

[2017-05-18 07:58:56,658] INFO Started S3 connector task with assigned 
partitions: [] (io.confluent.connect.s3.S3SinkTask:103)
[2017-05-18 07:58:56,661] INFO Sink task WorkerSinkTask{id=s3-sink-0} 
finished initialization and start 
(org.apache.kafka.connect.runtime.WorkerSinkTask:232)
[2017-05-18 07:58:58,083] INFO Discovered coordinator Kafka:9092 (id: 
2147483647 rack: null) for group connect-s3-sink. 
(org.apache.kafka.clients.consumer.internals.AbstractCoordinator:586)
[2017-05-18 07:58:58,181] INFO Revoking previously assigned partitions 
[] for group connect-s3-sink 
(org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:397)
[2017-05-18 07:58:58,181] INFO (Re-)joining group connect-s3-sink 
(org.apache.kafka.clients.consumer.internals.AbstractCoordinator:420)
[2017-05-18 07:58:58,361] INFO Successfully joined group connect-s3-
sink with generation 11 
(org.apache.kafka.clients.consumer.internals.AbstractCoordinator:388)
[2017-05-18 07:58:58,369] INFO Setting newly assigned partitions 
[s3_topic-0] for group connect-s3-sink 
(org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:256)
[2017-05-18 07:59:53,363] INFO Reflections took 89282 ms to scan 560 
urls, producing 12993 keys and 85595 values  
(org.reflections.Reflections:229)

0 个答案:

没有答案