Kafka HDFS连接器未显示任何数据

时间:2018-07-05 11:30:22

标签: hadoop apache-kafka hdfs apache-kafka-connect confluent

我收到以下消息:

 WorkerSinkTask{id=hdfs-test-0} Sink task finished initialization and start (org.apache.kafka.connect.runtime.WorkerSinkTask)
[2018-07-05 10:58:43,913] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Discovered group coordinator broker:19092 (id: 2147482646 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-07-05 10:58:43,919] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Revoking previously assigned partitions [] (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2018-07-05 10:58:43,920] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] (Re-)joining group (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-07-05 10:58:46,950] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Successfully joined group with generation 9 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-07-05 10:58:46,953] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Setting newly assigned partitions [hdfs-test-0] (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)
[2018-07-05 10:58:46,967] INFO [Consumer clientId=consumer-4, groupId=connect-hdfs-test] Resetting offset for partition hdfs-test-0 to offset 0. (org.apache.kafka.clients.consumer.internals.Fetcher)
[2018-07-05 10:58:46,978] INFO Started recovery for topic partition hdfs-test-0 (io.confluent.connect.hdfs.TopicPartitionWriter)
[2018-07-05 10:58:47,004] INFO Finished recovery for topic partition hdfs-test-0 (io.confluent.connect.hdfs.TopicPartitionWriter)

但是当我要检查HDFS中的数据是否可用时:

我只发现了这个:

$ hadoop fs -ls /topics/
Found 1 items
drwxr-xr-x   - root supergroup          0 2018-07-05 10:10 /topics/+tmp

我该怎么办?谁能帮我吗?

0 个答案:

没有答案