Question

我对导入多个数据（excel或csv）有疑问我知道如果我想同时读取多个excel数据（相同的列名），代码是：

library(readxl)
file.list <- dir(path = "/path", pattern='\\.xlsx', full.names = T)
df.list <- lapply(file.list, read_excel)
data <- rbindlist(df.list)

所以，我同时阅读它们并结合一个数据但是，我以我的一个数据为例在excel中， row1 具有标题名称， row2 为header，因此obs.从 row3 开始。<登记/> 此外，如果第一个数据在 EXCEL 中显示如下：

TITLE~~~~~
col1    col2    col3
A       1       3.59283E+14 
B       2       3.59258E+14
C       3       3.59286E+14
REFUND
A       -1      3.59286E+14

但是，col3在excel中被定义为数字。实际上，它看起来像：

TITLE~~~~~
col1    col2    col3
A       1       359283060959987 
B       2       359258069826064
C       3       359286062903911
REFUND
A       -1      359283060959987

Row6 有REFUND。在我的多个数据中，我不知道哪一行有REFUND。我想看看我的视线。没有这些行。我怎么办？实际上，col3是character。但在excel中，它看起来像numeric 导入到R时如何将其定义为character，因此在导入后，它不会显示指数符号。

Answer 1

我认为没有REFUND行可以直接读取您的数据，至少使用read_excel功能。然而，我在R中相当新，我可能是错的。

那就是说，我发生的第一件事就是建立自己的功能。下面的一个似乎有效。

library(readxl)
library(data.table)

file.list <- dir(path = ".", pattern='\\.xlsx', full.names = T)

my_read_data<-function(x){ #x list of files

  df.list<- lapply(x, function(x){read_excel(path=x,skip=1,col_names = TRUE,
                                             col_types=c("text","numeric","text"))})
  #skip -> skip the line with the title
  #col_names -> use the first row as column names, i.e., col1, col2 and col3
  #col_types-> vector containing one entry per column indicating the type of data

  my.data <- rbindlist(df.list)
  my.data.clean<-my.data[my.data$col1!="REFUND",]  #select only rows without "REFUND"

  return(my.data.clean)
}

为了运行该功能，我重复了四次excel示例，更改了REFUND行的位置。我得到的结果是如下。

the.data<-my_read_data(file.list) 

>the.data
   col1 col2            col3
1:    A    1 359283060959987
2:    B    2 359258069826064
3:    C    3 359286062903911
4:    A   -1 359283060959987
5:    A    1 359283060959987
6:    B    2 359258069826064
7:    C    3 359286062903911
8:    A   -1 359283060959987
9:    A    1 359283060959987
10:    B    2 359258069826064
11:    C    3 359286062903911
12:    A   -1 359283060959987
13:    A    1 359283060959987
14:    B    2 359258069826064
15:    C    3 359286062903911
16:    A   -1 359283060959987

编辑 - 将要更改的列传递给字符类型的函数

关于你的评论，也许你想要改为考虑这个功能：

my_read_data2<-function(x,character_col=NULL){ #x->list of files 
                                               # character_col->column to be change to character
                                              # can be more than one

  df.list<- lapply(x, function(x){read_excel(path=x,skip=1,col_names = TRUE)})
  my.data <- rbindlist(df.list)
  my.data.clean<-my.data[my.data$col1!="REFUND",]  #select only rows without "REFUND"

  # changing column selected by character_col to character
  # since the result from step above is a data table, 
  # access to elements is different from data frame

  if(!is.null(character_col)){ #this allow you to use the function using only
                               # default results from read_excel

      my.data.clean[, eval(character_col):= lapply(.SD, as.character),
                    .SDcols= character_col]
  }
  # eval -> you need to evaluate the argument you pass to the function,
  #         otherwise you'll end up with an additional character_col column
  #         that will be a list of all the columns you include in .SDcols
  #.SD -> is the subset of the data table, in this case 
  #       .SDcols specifies the columns that are included in .SD.

  return(my.data.clean[]) # in that case, don't forget the [] to avoid
                          #the odd behaviour when calling your resulting data table
                          #(see link at the end)                            
 }

示例：

    the.data<-my_read_data2(file.list)
str(the.data)

 >str(the.data)
    Classes ‘data.table’ and 'data.frame':  16 obs. of  3 variables:
    $ col1: chr  "A" "B" "C" "A" ...
    $ col2: num  1 2 3 -1 1 2 3 -1 1 2 ...
    $ col3: num  3.59e+14 3.59e+14 3.59e+14 3.59e+14 3.59e+14 ...
    - attr(*, ".internal.selfref")=<externalptr> 

the.data1<-my_read_data2(file.list,"col3")
str(the.data1) 

> str(the.data1)
    Classes ‘data.table’ and 'data.frame':  16 obs. of  3 variables:
    $ col1: chr  "A" "B" "C" "A" ...
    $ col2: num  1 2 3 -1 1 2 3 -1 1 2 ...
    $ col3: chr  "359283060959987" "359258069826064" "359286062903911" "359283060959987" ...
    - attr(*, ".internal.selfref")=<externalptr>

您还可以使用多个列：

the.data2<-my_read_data2(file.list,c("col2","col3"))
the.data3<-my_read_data2(file.list,c(2,3))

data.table objects not printed after returned from function

希望它可以帮到你

导入数据格式

1 个答案: