" [LoadIncrementalHFiles-0] client.RpcRetryingCaller:调用异常"

时间:2017-02-17 06:31:57

标签: hbase bulk-load

当我使用以下命令在s3上使用hbase批量加载时: 1.创造人物' ,{NAME => ' bs'},{NAME => ' ml',},SPLITS => [' a','',' c',' d',' e'' F&#39] 2. hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator =, - Dimporttsv.columns = HBASE_ROW_KEY,bs:game_id_1,bs:data_desc_1,bs:register_time_1,bs:uid_1,bs:last_load_1,bs:load_status_1 ,BS:max_step_1,BS:tutorial_times_1,BS:initial_lev_1,BS:area_id_1,BS:game_id_2,BS:data_desc_2,BS:register_time_2,BS:uid_2,BS:last_load_2,BS:load_status_2,BS:max_step_2,BS:tutorial_times_2,BS :initial_lev_2,BS:area_id_2,BS:game_id_3,BS:data_desc_3,BS:register_time_3,BS:uid_3,BS:last_load_3,BS:load_status_3,BS:max_step_3,BS:tutorial_times_3,BS:initial_lev_3,BS:area_id_3,BS:game_id_4 ,BS:data_desc_4,BS:register_time_4,BS:uid_4,BS:last_load_4,BS:load_status_4,BS:max_step_4,BS:tutorial_times_4,BS:initial_lev_4,BS:area_id_4,BS:game_id_5,BS:data_desc_5,BS:register_time_5,BS :uid_5,BS:last_load_5,BS:load_status_5,BS:max_step_5,BS:tutorial_times_5,BS:initial_lev_5,BS:area_id_5,BS:game_id_6,BS:data_desc_6,BS:register_time_6,BS:uid_6,BS:last_load_6,BS:load_status_6 ,BS:max_step_6,BS:tutorial_times_6,BS:初始化ial_lev_6,BS:area_id_6,BS:game_id_7,BS:data_desc_7,BS:register_time_7,BS:uid_7,BS:last_load_7,BS:load_status_7,BS:max_step_7,BS:tutorial_times_7,BS:initial_lev_7,BS:area_id_7,BS:game_id_8, BS:data_desc_8,BS:register_time_8,BS:uid_8,BS:last_load_8,BS:load_status_8,BS:max_step_8,BS:tutorial_times_8,BS:initial_lev_8,BS:area_id_8,BS:game_id_9,BS:data_desc_9,BS:register_time_9,BS: uid_9,BS:last_load_9,BS:load_status_9,BS:max_step_9,BS:tutorial_times_9,BS:initial_lev_9,BS:area_id_9,BS:game_id_10,BS:data_desc_10,BS:register_time_10,BS:uid_10,BS:last_load_10,BS:load_status_10, BS:max_step_10,BS:tutorial_times_10,BS:initial_lev_10,BS:area_id_10,毫升:game_id_11,毫升:data_desc_11,毫升:register_time_11,毫升:uid_11,毫升:last_load_11,毫升:load_status_11,毫升:max_step_11,毫升:tutorial_times_11,毫升: initial_lev_11,毫升:area_id_11,毫升:game_id_12,毫升:data_desc_12,毫升:register_time_12,毫升:uid_12,毫升:last_load_12,毫升:load_status_12,毫升:max_step_12,毫升:tutorial_times_12,毫升:initial_lev_12,毫升:area_id_12,毫升:game_id_13,毫升:data_desc_13,毫升​​:重新gister_time_13,毫升​​:uid_13,毫升​​:last_load_13,毫升​​:load_status_13,毫升​​:max_step_13,毫升​​:tutorial_times_13,毫升​​:initial_lev_13,毫升​​:area_id_13,毫升​​:game_id_14,毫升:data_desc_14,毫升:register_time_14,毫升:uid_14,毫升:last_load_14,毫升:load_status_14,毫升:max_step_14,毫升:tutorial_times_14,毫升:initial_lev_14,毫升:area_id_14,毫升:game_id_15,毫升:data_desc_15,毫升:register_time_15,毫升:uid_15,毫升:last_load_15,毫升:load_status_15,毫升:max_step_15,毫升: tutorial_times_15,毫升:initial_lev_15,毫升:area_id_15,毫升:game_id_16,毫升:data_desc_16,毫升:register_time_16,毫升:uid_16,毫升:last_load_16,毫升:load_status_16,毫升:max_step_16,毫升:tutorial_times_16,毫升:initial_lev_16,毫升:area_id_16,毫升:game_id_17,毫升:data_desc_17,毫升:register_time_17,毫升:uid_17,毫升:last_load_17,毫升:load_status_17,毫升:max_step_17,毫升:tutorial_times_17,毫升:initial_lev_17,毫升:area_id_17,毫升:game_id_18,毫升:data_desc_18,毫升: register_time_18,毫升:uid_18,毫升:last_load_18,毫升:load_status_18,毫升:max_step_18,毫升:tutorial_times_18,毫升:initial_lev_18,毫升:area_id_18,毫升:game_id_19,毫升:data_desc_19,毫升:register_time_19,毫升:uid_19,毫升: last_load_19,毫升:load_status_19,毫升:max_step_19,毫升:tutorial_times_19,毫升:initial_lev_19,毫升:area_id_19,毫升:game_id_20,毫升:data_desc_20,毫升:register_time_20,毫升:uid_20,毫升:last_load_20,毫升:load_status_20,毫升:max_step_20, ml:tutorial_times_20,ml:initial_lev_20,ml:area_id_20 -Dimporttsv.bulk.output = s3:// allen-spark-test / hfile / user_400w0000 personas s3:// architecture_bucket / user_4000w / 0000_part_00 -Dimporttsv.skip.bad.lines =真正 3.hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles s3:// allen-spark-test / hfile / user_400w0000 / _temporary / 1 / _temporary / attempt_1487298628615_0001_r_000000_0 personas

在第3步,一遍又一遍地发出这样的错误,有没有人可以告诉我如何解决这个问题,提前谢谢。

2017-02-17 05:46:48,050 INFO [LoadIncrementalHFiles-0] mapreduce.LoadIncrementalHFiles:尝试加载hfile = s3:// allen-spark-test / hfile / user_400w0000 / _temporary / 1 / _temporary / attempt_1487298628615_0001_r_000000_0 / ml / f0bd47760d924d8892b72aa574150b19 first = 58_9999_1126028772568700 last = 9_9999_999936924 2017-02-17 05:46:48,161 INFO [LoadIncrementalHFiles-1] mapreduce.LoadIncrementalHFiles:尝试加载hfile = s3:// allen-spark-test / hfile / user_400w0000 / _temporary / 1 / _temporary / attempt_1487298628615_0001_r_000000_0 / ml / 78256ffc03344532971ede95be892ce4 first = 1_9999_100002476412552 last = 58_9999_1126028772568574 2017-02-17 05:58:26,647 INFO [LoadIncrementalHFiles-0] client.RpcRetryingCaller:调用异常,尝试= 10,重试= 35,启动= 698473毫秒前,取消=假,msg =行'&# 39;在桌子上' personas' at region = personas ,, 1487300932958.3cc86282fc8b90516c400ab447234ab7。,hostname = ip-10-16-212-143.ec2.internal,16020,1487298695908,seqNum = 2 2017-02-17 05:59:36,665 INFO [LoadIncrementalHFiles-0] client.RpcRetryingCaller:调用异常,tries = 11,retries = 35,started = 768492 ms前,取消= false,msg = row'&# 39;在桌子上' personas' at region = personas ,, 1487300932958.3cc86282fc8b90516c400ab447234ab7。,hostname = ip-10-16-212-143.ec2.internal,16020,1487298695908,seqNum = 2 2017-02-17 06:00:56,803 INFO [LoadIncrementalHFiles-0] client.RpcRetryingCaller:调用异常,尝试= 12,重试= 35,启动= 848630毫秒前,取消=假,msg =行'&# 39;在桌子上' personas' at region = personas ,, 1487300932958.3cc86282fc8b90516c400ab447234ab7。,hostname = ip-10-16-212-143.ec2.internal,16020,1487298695908,seqNum = 2 2017-02-17 06:02:16,930 INFO [LoadIncrementalHFiles-0] client.RpcRetryingCaller:调用异常,尝试= 13,重试= 35,开始= 928757毫秒前,取消=假,msg =行'&# 39;在桌子上' personas' at region = personas ,, 1487300932958.3cc86282fc8b90516c400ab447234ab7。,hostname = ip-10-16-212-143.ec2.internal,16020,1487298695908,seqNum = 2 2017-02-17 06:03:37,066 INFO [LoadIncrementalHFiles-0] client.RpcRetryingCaller:调用异常,尝试= 14,重试= 35,启动= 1008892毫秒前,取消=假,msg =行'&# 39;在桌子上' personas' at region = personas ,, 1487300932958.3cc86282fc8b90516c400ab447234ab7。,hostname = ip-10-16-212-143.ec2.internal,16020,1487298695908,seqNum = 2

0 个答案:

没有答案