R:树上的聚合值

时间:2015-08-09 00:41:54

标签: r tree data.table aggregate

这个问题类似于this,但它有一个C#答案,我需要一个R答案。

我有大约50个大约650行的文件,其格式和数据与此玩具数据非常相似:

dput(y)
structure(list(level1 = c(4L, 4L, 4L, 4L, 4L, 4L, 4L, 4L, 4L, 
4L, 4L, 4L), level2 = c(NA, 41L, 41L, 41L, 41L, 41L, 41L, 41L, 
42L, 42L, 42L, 42L), level3 = c(NA, NA, 4120L, 4120L, 4120L, 
4120L, 4120L, 4120L, NA, 4210L, 4210L, 4210L), level4 = c(NA, 
NA, NA, 412030L, 412030L, 412050L, 412050L, 412050L, NA, NA, 
421005L, 421005L), pid = c(NA, NA, NA, NA, 123456L, NA, 789012L, 
345678L, NA, NA, NA, 901234L), description = c("income", "op.income", 
"manuf.industries", "manuf 1", "client 1", "manuf 2", "client 2", 
"client 3", "non-op.income", "financial", "interest", "bank 1"
), value = c(NA, NA, NA, NA, 15000L, NA, 272860L, 1150000L, NA, 
NA, NA, 378L)), .Names = c("level1", "level2", "level3", "level4", 
"pid", "description", "value"), class = c("data.table", "data.frame"
), row.names = c(NA, -12L), .internal.selfref = <pointer: 0x00000000001a0788>)

value上具有值的每一行都是&#34; leaf&#34; o树,在level列1到4中标识分支。我想通过brach汇总叶子并将相应的值放在value列中。

我的预期输出如下:

dput(res)
structure(list(level1 = c(4L, 4L, 4L, 4L, 4L, 4L, 4L, 4L, 4L, 
4L, 4L, 4L), level2 = c(NA, 41L, 41L, 41L, 41L, 41L, 41L, 41L, 
42L, 42L, 42L, 42L), level3 = c(NA, NA, 4120L, 4120L, 4120L, 
4120L, 4120L, 4120L, NA, 4210L, 4210L, 4210L), level4 = c(NA, 
NA, NA, 412030L, 412030L, 412050L, 412050L, 412050L, NA, NA, 
421005L, 421005L), pid = c(NA, NA, NA, NA, 123456L, NA, 789012L, 
345678L, NA, NA, NA, 901234L), description = c("income", "op.income", 
"manuf.industries", "manuf 1", "client 1", "manuf 2", "client 2", 
"client 3", "non-op.income", "financial", "interest", "bank 1"
), value = c(1438238L, 1437860L, 1437860L, 15000L, 15000L, 1422860L, 
272860L, 1150000L, 378L, 378L, 378L, 378L)), .Names = c("level1", 
"level2", "level3", "level4", "pid", "description", "value"), class = c("data.table", 
"data.frame"), row.names = c(NA, -12L), .internal.selfref = <pointer: 0x00000000001a0788>)

我知道这可以通过for循环完成,但我想知道是否有更快,更简单的替代方案(我更喜欢data.table或基础解决方案,但任何其他包也可以正常工作)。到目前为止我尝试过的事情:

z4<-y[!is.na(pid),sum(value),by=level4]
setkey(y,"level4");setkey(z4,"level4")
y[z4,][is.na(pid)]

这会在V1中显示所需的值,因此我想知道是否可以将它们分配给value

y[z4,][is.na(pid),value:=i.V1]
Error in eval(expr, envir, enclos) : object 'i.V1' not found

我认为这可能是因为电话i.V1位于链接[而非初始y[z4电话中。但是,如果我只在z4上进行子集,我怎么知道我应该分配哪些匹配的level4行(这就是我考虑使用is.na(pid)的原因,因为y[z4,value:=i.V1]产生了错误的结果,因为它更新了与level4匹配的所有值。

正如你所看到的,我对这个问题严重不满,并且用我的方法&#34;我还有3个级别要去。

有没有更简单的方法呢?

1 个答案:

答案 0 :(得分:2)

因为每个级别的计算需要前一级别的计算,所以我认为需要循环或递归。这是一个递归函数,用于使用基数R获取值。您可以使用data.table执行类似的操作,这可能会更有效。

## Use y as data.frame
y <- as.data.frame(y)

## Recursive function to get values
f <- function(data, lvl=NULL) {
    if (is.null(lvl)) lvl <- 1                                                 # initialize level
    if (lvl == 5) return (data)                                                # we are done
    cname <- paste0("level", lvl)                                              # name of current level
    nname <- ifelse (lvl == 4, "pid", paste0("level", lvl+1))                  # name of next level
    agg <- aggregate(as.formula(paste("value~", cname)), data=data, sum)       # aggregate data
    inds <- (ms <- match(data[,cname], agg[,cname], F)) & is.na(data[,nname])  # find index of leaves to fill
    data$value[inds] <- agg$value[ms[inds]]                                    # add new values
    f(data, lvl+1)                                                             # recurse
}

f(data=y)
#    level1 level2 level3 level4    pid      description   value
# 1       4     NA     NA     NA     NA           income 1438238
# 2       4     41     NA     NA     NA        op.income 1437860
# 3       4     41   4120     NA     NA manuf.industries 1437860
# 4       4     41   4120 412030     NA          manuf 1   15000
# 5       4     41   4120 412030 123456         client 1   15000
# 6       4     41   4120 412050     NA          manuf 2 1422860
# 7       4     41   4120 412050 789012         client 2  272860
# 8       4     41   4120 412050 345678         client 3 1150000
# 9       4     42     NA     NA     NA    non-op.income     378
# 10      4     42   4210     NA     NA        financial     378
# 11      4     42   4210 421005     NA         interest     378
# 12      4     42   4210 421005 901234           bank 1     378

我认为只需聚合一部分数据,就可以提高聚合步骤的效率。老实说,这很有趣,但循环可能是要走的路。