修复cassandra数据

时间:2016-02-24 17:50:29

标签: cassandra repair

我有一个cassandra集群的游乐场 - 服务器硬件上的7个节点(v.2.2.4)没有网络问题。 RF等于3。 对于加载数据,启动了生成测试数据的脚本。 A"表"有大约2b条记录。

我在执行脚本期间运行了子范围修复程序。结果,修复某些部分失败了。 然后开始升级执行程序,这也是错误执行的,所以 sstablescrub开始了。在sstablescrub过程之后,某些段的修复再次失败。

在我的案例中,哪些原因可以解决修复问题?

是否应在群集的每个节点上启动sstablescrub?

子范围修复的脚本。我希望它对某些人有用。

ring=( $($vCSBIN/nodetool ring | grep -oE '[-]?[0-9]{19}') )

for ((i=0; i<$((${#ring[@]}-1)); i++));
    do
        echo "st = ${ring[i]}, et = ${ring[i+1]}"
        $vCSBIN/nodetool repair -st "${ring[i]}" -et "${ring[i+1]}"
    done

system.log的片段:

INFO  [Thread-59449] 2016-02-22 13:14:08,916 RepairSession.java:237 - 

[repair #110b9d40-d990-11e5-a89b-41ca3fbac573] new session: will sync cassandra1111.mydomain.com/10.0.0.0.77, /10.0.0.0.85, /10.0.0.0.192 on range (-4991002611964638502,-4985574971950992136] for ks1.[t1, counters]
INFO  [Repair#1997:1] 2016-02-22 13:14:08,918 RepairJob.java:107 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] requesting merkle trees for t1 (to [/10.0.0.0.85, /10.0.0.0.192, cassandra1111.mydomain.com/10.0.0.0.77])
INFO  [Repair#1997:1] 2016-02-22 13:14:08,918 RepairJob.java:181 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] Requesting merkle trees for t1 (to [/10.0.0.0.85, /10.0.0.0.192, cassandra1111.mydomain.com/10.0.0.0.77])
ERROR [ValidationExecutor:7] 2016-02-22 13:14:08,919 Validator.java:246 - Failed creating a merkle tree for [repair #110b9d40-d990-11e5-a89b-41ca3fbac573 on ks1/t1, (-4991002611964638502,-4985574971950992136]], /10.0.0.0.77 (see log for details)
INFO  [AntiEntropyStage:1] 2016-02-22 13:14:08,920 RepairSession.java:181 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] Received merkle tree for t1 from /10.0.0.0.77
WARN  [RepairJobTask:1] 2016-02-22 13:14:08,920 RepairJob.java:162 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] t1 sync failed
INFO  [Repair#1997:2] 2016-02-22 13:14:08,920 RepairJob.java:107 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] requesting merkle trees for counters (to [/10.0.0.0.85, /10.0.0.0.192, cassandra1111.mydomain.com/10.0.0.0.77])
org.apache.cassandra.exceptions.RepairException: [repair #110b9d40-d990-11e5-a89b-41ca3fbac573 on ks1/t1, (-4991002611964638502,-4985574971950992136]] Validation failed in cassandra1111.mydomain.com/10.0.0.0.77
INFO  [Repair#1997:2] 2016-02-22 13:14:08,920 RepairJob.java:181 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] Requesting merkle trees for counters (to [/10.0.0.0.85, /10.0.0.0.192, cassandra1111.mydomain.com/10.0.0.0.77])
com.google.common.util.concurrent.UncheckedExecutionException: org.apache.cassandra.exceptions.RepairException: [repair #110b9d40-d990-11e5-a89b-41ca3fbac573 on ks1/t1, (-4991002611964638502,-4985574971950992136]] Validation failed in cassandra1111.mydomain.com/10.0.0.0.77
Caused by: org.apache.cassandra.exceptions.RepairException: [repair #110b9d40-d990-11e5-a89b-41ca3fbac573 on ks1/t1, (-4991002611964638502,-4985574971950992136]] Validation failed in cassandra1111.mydomain.com/10.0.0.0.77
INFO  [AntiEntropyStage:1] 2016-02-22 13:14:08,920 RepairSession.java:181 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] Received merkle tree for t1 from /10.0.0.0.85
ERROR [RepairJobTask:1] 2016-02-22 13:14:08,921 RepairSession.java:290 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] Session completed with the following error
org.apache.cassandra.exceptions.RepairException: [repair #110b9d40-d990-11e5-a89b-41ca3fbac573 on ks1/t1, (-4991002611964638502,-4985574971950992136]] Validation failed in cassandra1111.mydomain.com/10.0.0.0.77
INFO  [AntiEntropyStage:1] 2016-02-22 13:14:08,921 RepairSession.java:181 - [repair #110b9d40-d990-11e5-a89b-41ca3fbac573] Received merkle tree for t1 from /10.0.0.0.192
ERROR [RepairJobTask:1] 2016-02-22 13:14:08,921 RepairRunnable.java:243 - Repair session 110b9d40-d990-11e5-a89b-41ca3fbac573 for range (-4991002611964638502,-4985574971950992136] failed with error [repair #110b9d40-d990-11e5-a89b-41ca3fbac573 on ks1/t1, (-4991002611964638502,-4985574971950992136]] Validation failed in cassandra1111.mydomain.com/10.0.0.0.77
org.apache.cassandra.exceptions.RepairException: [repair #110b9d40-d990-11e5-a89b-41ca3fbac573 on ks1/t1, (-4991002611964638502,-4985574971950992136]] Validation failed in cassandra1111.mydomain.com/10.0.0.0.77

0 个答案:

没有答案