使用data.table来自汇总组的摘要统计信息

时间:2018-10-14 15:52:43

标签: r data.table aggregate summarize

我有一个具有以下结构的数据集:

library(data.table)    
dt <- data.table(
  record=c(1:20),
  area=rep(LETTERS[1:4], c(4, 6, 3, 7)), 
  score=c(1,1:3,2:3,1,1,1,2,2,1,2,1,1,1,1,1:3),
  cluster=c("X", "Y", "Z")[c(1,1:3,3,2,1,1:3,1,1:3,3,3,3,1:3)]
)

我想汇总数据,以便可以针对给定的分数(例如1)确定每个区域中最常见的聚类。我还希望通过如下所示的输出来计算一些基本频率和百分比:

dt_summary_for_1_score <- data.table(
  area=c("A","B","C","D"),
  cluster_mode=c("X","X","X","Z"),
  cluster_pct = c(100,66.6,100,80),
  cluster_freq = c(2,2,1,4),
  record_freq = c(2,3,1,5)
)

理想情况下,我想要一个使用data.table的解决方案。谢谢。

1 个答案:

答案 0 :(得分:1)

我会利用frank,尽管也可以使用sort(table(cluster))解决方案。

dt_summary = 
  dt[ , .N, keyby = .(area, score, cluster)
      ][ , {
        idx = frank(-N, ties.method = 'min') == 1
        NN = sum(N)
        .(
          cluster_mode = cluster[idx],
          cluster_pct = 100*N[idx]/NN,
          cluster_freq = N[idx],
          record_freq = NN
        )
      }, by = .(area, score)]

要获得score == 1的示例,我们可以将其子集化:

dt_summary[score == 1]
#    area score cluster_mode cluster_pct cluster_freq record_freq
# 1:    A     1            X   100.00000            2           2
# 2:    B     1            X    66.66667            2           3
# 3:    C     1            X   100.00000            1           1
# 4:    D     1            Z    80.00000            4           5

对于平局,这将返回不同的。您可以尝试使用cluster_mode = paste(cluster[idx], collapse = '|')cluster_mode = list(cluster[idx])之类的方法来代替。

打破逻辑:

# Count how many times each cluster shows up with each area/score
dt[ , .N, keyby = .(area, score, cluster)
   ][ , {

    # Rank each cluster's count within each area/score & take the top;
    #   ties.method = 'min' guarantees that if there's
    #   a tie for "winner", _both_ will get rank 1
    #   (by default, ties.method = 'average')
    # Note that it is slightly inefficient to negate N
    #   in order to sort in descending order, especially
    #   if there are a large number of groups. We could
    #   either vectorize negation by using -.N in the 
    #   previous step or by using frankv (a lower-level
    #   version of frank) which has an 'order' argument
    idx = frank(-N, ties.method = 'min') == 1

    # calculate here since it's used twice
    NN = sum(N)

    .(
      # use [idx] to subset and make sure there are
      #   only as many rows on output as there are
      #   top-ranked clusters for this area/score
      cluster_mode = cluster[idx],
      cluster_pct = 100*N[idx]/NN,
      cluster_freq = N[idx],
      record_freq = NN
    )
  }, by = .(area, score)]