抛出org.apache.kafka.connect.runtime.distributed.RebalanceNeededException的连接器创建

Question

在创建连接器后请求时，出现以下错误：

 Error message : 500 Internal Server Error,
 error response: {"error_code":500,"message":"org.apache.kafka.connect.runtime.distributed.RebalanceNeededException: Request cannot be completed because a rebalance is expected"}

Requst body:
{"name":"pg_sink_connector_ansv_mc","config":{"name":"pg_sink_connector_ansv_mc","connector.class":"io.confluent.connect.jdbc.JdbcSinkConnector","connection.user":"postgres","database.dbname":"ansv_mc","connection.password":"postgres","topics":"ansv_mc.public.discovery_channel_message","transforms":"unwrap","transforms.unwrap.type":"io.debezium.transforms.ExtractNewRecordState","database.server.name":"ansv_mc","database.port":"5432","auto.create":"true","database.hostname":"pg-common,"connection.url":"jdbc:postgresql://pg-common.postgres????????"}}

Answer 1

您正在使用接收器连接器，简单来说，它是Kafka使用者，可以从Kafka读取记录并写入postgres。

进行重新平衡时，Kafka使用者无法读取（Kafka正在将分区分配给组中的使用者）。查看详细信息here

这应该是一个间歇性问题，接收器连接器应在以下迭代中恢复。