Question

我正在尝试在Kafka 1.0.1上运行Kafka Mirror maker，以下是Target Cluster中的配置。

source.config

bootstrap.servers=XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092
groupid=test-MirrorMaker-group
exclude.internal.topics=true
mirror.topics.whitelist=test
client.id=mirror_maker_consumer

target.config

bootstrap.servers=XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092,XX.XXX.XX.XXX:9092
acks=1
batch.size=100
client.id=mirror_maker_producer

当我运行以下命令在目标集群上启动镜像生成器时。

./ kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config ../config/source.config --producer.config ../config/target.config --num.streams 2 - -whitelist =＆＃34;测试＆＃34;

我收到以下错误

[2018-03-22 20:52:09,164] WARN The configuration 'groupid' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,164] WARN The configuration 'mirror.topics.whitelist' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,174] WARN The configuration 'groupid' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,174] WARN The configuration 'mirror.topics.whitelist' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
[2018-03-22 20:52:09,373] ERROR [Consumer clientId=null-0, groupId=] Attempt to join group failed due to fatal error: The configured groupId is invalid (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-03-22 20:52:09,375] FATAL [mirrormaker-thread-0] Mirror maker thread failure due to  (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.errors.InvalidGroupIdException: The configured groupId is invalid
[2018-03-22 20:52:09,375] ERROR [Consumer clientId=null-1, groupId=] Attempt to join group failed due to fatal error: The configured groupId is invalid (org.apache.kafka.clients.consumer.internals.AbstractCoordinator)
[2018-03-22 20:52:09,377] FATAL [mirrormaker-thread-1] Mirror maker thread failure due to  (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.errors.InvalidGroupIdException: The configured groupId is invalid
[2018-03-22 20:52:09,386] FATAL [mirrormaker-thread-1] Mirror maker thread exited abnormally, stopping the whole mirror maker. (kafka.tools.MirrorMaker$MirrorMakerThread)

我错过了什么吗？

Answer 1

You have a typo. Replace groupid with group.id.

Kafka Mirror Maker启动错误

1 个答案: