Kafka连接未手动加载HDFS接收器连接

时间:2019-10-22 14:01:06

标签: apache-kafka-connect

[2019-10-22 13:36:41,286]错误连接器错误后停止(org.apache.kafka.connect.cli.ConnectStandalone:91)org.apache.kafka.common.config.ConfigException:无效值io用于配置连接器的.confluent.connect.hdfs3.Hdfs3SinkConnector.class:找不到类io.confluent.connect.hdfs3.Hdfs3SinkConnector。在org.apache.kafka.common.config.ConfigDef.parseType(ConfigDef.java:255)在org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:145)在org.apache.kafka.common org.apache.kafka.com上的.config.AbstractConfig。(AbstractConfig.java:49).org.apache.kafka.connect.runtime.ConnectorConfig上的.config.AbstractConfig。(AbstractConfig.java:56)。(ConnectorConfig.java: 71)在org.org.apache.kafka.connect.runtime.standalone.StandaloneHerder.startConnector(StandaloneHerder.java:194)在org.org.apache.kafka.connect.runtime.standalone.StandaloneHerder.putConnectorConfig(StandaloneHerder.java:145) .apache.kafka.connect.cli.ConnectStandalone.main(ConnectStandalone.java:85)

1)我已经解压缩了confluentinc-kafka-connect-hdfs3-1.0.3-preview,并在服务器中添加了/ usr / local / kafka / plugin文件夹。 2)我正在运行:./bin/connect-standalone.sh ./config/hdfs-connect-standalone3.properties ./etc/quickstart-hdfs3.properties

etc / quickstart-hdfs3.properties:

名称= hdfs-接收器连接器.class = io.confluent.connect.hdfs3.Hdfs3SinkConnector任务.max = 1主题= test_hdfs hdfs.url = file:/// usr / local / kafka /文件flush.size = 3

/config/hdfs-connect-standalone3.properties:

key.converter = org.apache.kafka.connect.json.JsonConverter value.converter = org.apache.kafka.connect.json.JsonConverter key.converter.schemas.enable = false value.converter.schemas.enable =错误

internal.key.converter = org.apache.kafka.connect.json.JsonConverter internal.value.converter = org.apache.kafka.connect.json.JsonConverter internal.key.converter.schemas.enable = false内部。 value.converter.schemas.enable = false

offset.storage.file.filename = / tmp / connect.offsets offset.flush.interval.ms = 10000 plugin.path = / usr / local / kafka / plugins / lib,/ usr / local / kafka / plugins / lib2,/ usr / local / kafka / lib

0 个答案:

没有答案