Question

我们看到了ReplicationFactor：1而不是ReplicationFactor：3

/usr/hdp/current/kafka-broker/bin/kafka-topics.sh --zookeeper 172.23.12.33:2181 --describe |  grep  __consumer_offsets Topic:__consumer_offsets        PartitionCount:50       ReplicationFactor:1     Configs:segment.bytes=104857600,cleanup.policy=compact,compression.type=producer

所以因为我们运行以下过程以便获得ReplicationFactor：1而不是ReplicationFactor：3

但是当我们跑步时

kafka-reassign-partitions --zookeeper $ZOOKEEPER_CONNECT \    --reassignment-json-file /home/liquidnt/inc-replication-factor.json  \    --verify

我们仍然在进步！！！

这是正常行为吗？，我们需要等待吗？直到现在，我们在手术2小时后仍然看到-进行中

1。该过程（经纪人ID为-0,1,2,3,4）

链接-https://gist.github.com/uarun/da30d8ef52b5d57b145cd13694c8acdc

创建一个自定义重新分配计划（请参阅附件文件inc-replication-factor.json）。在这种情况下，我们将复制因子从1改为3。

{"version":1,
 "partitions":[
   {"topic":"__consumer_offsets", "partition":0,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":1,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":2,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":3,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":4,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":5,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":6,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":7,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":8,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":9,  "replicas":[0, 1, 2]},
   {"topic":"__consumer_offsets", "partition":10, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":11, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":12, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":13, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":14, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":15, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":16, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":17, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":18, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":19, "replicas":[1, 2, 3]},
   {"topic":"__consumer_offsets", "partition":20, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":21, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":22, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":23, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":24, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":25, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":26, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":27, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":28, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":29, "replicas":[2, 3, 4]},
   {"topic":"__consumer_offsets", "partition":30, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":31, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":32, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":33, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":34, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":35, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":36, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":37, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":38, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":39, "replicas":[3, 4, 0]},
   {"topic":"__consumer_offsets", "partition":40, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":41, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":42, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":43, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":44, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":45, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":46, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":47, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":48, "replicas":[4, 0, 1]},
   {"topic":"__consumer_offsets", "partition":49, "replicas":[4, 0, 1]}
 ]
}

2。运行Kafka分区重新分配脚本：

kafka-reassign-partitions --zookeeper $ ZOOKEEPER_CONNECT \ --reassignment-json-file /home/liquidnt/inc-replication-factor.json \ --execute

3。验证分配是否成功

kafka-reassign-partitions --zookeeper $ ZOOKEEPER_CONNECT \ --reassignment-json-file /home/liquidnt/inc-replication-factor.json \ --verify

4。更多验证

./ kafka-topics --zookeeper $ ZOOKEEPER_CONNECT-描述--topic __consumer_offsets

主题的复制因子增加，但仍在进行中

0 个答案: