采样结果与hive sql中的条件

时间:2018-05-21 19:09:34

标签: sql database hive hiveql hive-partitions

我有一个没有主键的表,并按日期分区;像这样的列:

1. user_id  
2. device
3. region
4. datetime
5. and other columns

它包含来自网站游戏的用户生成的事件,它们每秒触发一次。我想返回一个批处理,其中包含当前检查条件的前6位用户(表格顶部)生成的所有事件(包括重复行):

for region = US

- one user from iOS
- one user from android
- one user from PC

for region = EU

- one user from iOS
- one user from android
- one user from PC

您能提供我应该从哪里开始的示例代码吗?我的一个朋友提出了一些关于RANK()的建议,但我从未使用它。

谢谢!

SELECT * FROM 
    (SELECT user_id, 
    event_post_time, 
    device, 
    region, 
    COUNT(DISTINCT player_id) over (partition by player_id) as ct_pid, 
    COUNT(DISTINCT region) over (partition by region) as ct_region, 
    COUNT(DISTINCT device) over (partition by device) as ct_device 
    FROM events 
    WHERE event_post_time = current_date() 
    AND region IN ('EU','US') 
    AND device IN ('ios','android','pc')) e 
WHERE ct_pid <= 6 
AND ct_region <= 2 
AND ct_device <= 3 
ORDER BY player_id

SQLFiddle添加虚拟数据 和预期产出:

user_id device region date_generated
  1  ios  EU  22-05-18
  1  ios  EU  22-05-18
  1  ios  EU  22-05-18
  4  ios  US  22-05-18
  4  ios  US  22-05-18
  2  android  EU  22-05-18
  2  android  US  22-05-18
  4  pc  EU  22-05-18
  4  pc  EU  22-05-18
  4  pc  EU  22-05-18
  5  pc  US  22-05-18

1 个答案:

答案 0 :(得分:0)

可能这就是你要找的东西。

select * from (
select rank() over (partition by region,device order by cn desc) as
top_num,player_id, region,device,cn from 
(
select count(*) as cn , player_id,region,device from 
test_table group by player_id,region,device 
)l
)t 
where top_num = 1;

如果有帮助,请告诉我。

OP编辑: 我设法使用您提供的查询使其适用于我想要的内容;这是最后一个

WITH combo 
 AS (SELECT user_id, 
            region, 
            device 
     FROM   (SELECT Rank() 
                      OVER ( 
                        partition BY region, device 
                        ORDER BY cn DESC) AS top_num, 
                    user_id, 
                    region, 
                    device, 
                    cn 
             FROM   (SELECT Count(*) AS cn, 
                            user_id, 
                            region, 
                            device 
                     FROM   samples 
                     GROUP  BY user_id, 
                               region, 
                               device)l)t 
     WHERE  top_num = 1) 
SELECT s.user_id, 
   s.region, 
   s.device 
FROM   samples s 
   JOIN combo 
     ON s.user_id = combo.user_id 
        AND s.region = combo.region 
        AND s.device = combo.device