如何将两列合并为一个列,如蜂巢中的地图?

时间:2020-07-10 03:29:28

标签: arrays dictionary hive hiveql

在配置单元中,表中有两列:

user_id    product_id    score
1          1, 2, 3       0.7, 0.2, 0.1
2          2, 3, 1       0.5, 0.25, 0.25

product_id的类型和得分均为字符串。现在,我希望生成一个新列,该列由product_id和得分进行组合,如下所示:

user_id    product_score
1          1:0.7, 2:0.2, 3:0.1
2          2:0.5, 3:0.25, 1:0.25

在新表中,product_score列就像一个映射,product_id是键,score是值,但实际上它仍然是字符串。 product_id和成绩由“:”连接。不同的product_id通过“,”连接,并按照初始表中product_id中的初始顺序排序。我该如何实现?

2 个答案:

答案 0 :(得分:1)

使用split()获取数组,使用map()转换为地图

select user_id, 
       map(product_id[0], score[0],
           product_id[1], score[1], 
           product_id[2], score[2]
       ) as product_score

(
select user_id, split(product_id,',') as product_id, split(score,',') as score
  from ...
)s;

答案 1 :(得分:0)

已解决-按顺序合并两个数组列(如键和值映射)

方法-使用posexplode方法分解数组,并从多列中获得相等的pos值

SQL查询-

with rowidcol as 
(
   select user_id, split(product_id, ',') prod_arr, split(score, ',') score_arr, row_number() over() as row_id 
   from prod 
),
coltorows as 
(
   select row_id, user_id, prod_arr[prd_index] product, score_arr[score_index] score, prd_index, score_index 
   from rowidcol 
      LATERAL view posexplode(prod_arr) ptable as prd_index, pdid 
      LATERAL view posexplode(score_arr) prtable as score_index, sid 
),
colselect as 
(
   select row_id, user_id, collect_list(concat(product, ':', score)) product_score 
   from coltorows 
   where prd_index = score_index 
   group by row_id, user_id 
)
select user_id, concat_ws(',', product_score) as prodcut_score 
from colselect 
order by user_id;

输入- 表名-产品-

user_id  product_id    score     
1         A,B,C,D      10,20,30,40       
2         X,Y,Z        1,2,3         
3         K,F,G        100,200,300

输出-

user_id   prodcut_score    
1         A:10,B:20,C:30,D:40     
2         X:1,Y:2,Z:3        
3         K:100,F:200,G:300