Question

我正在玩R。我想从dictionary文件创建txt。我有2个.txt文件：

#1.txt
 sky,
 sun

#2.txt
blue,
bright

要在R中加载这两个文件，我将执行以下操作：

library(tm)
txt_files = list.files(pattern = '*.txt');
data = lapply(txt_files, read.table, sep = ",")
 #here I get error
  Error in scan(file, what, nmax, sep, dec, quote, skip, nlines, na.strings,  : 
   line 2 did not have 2 elements
   In addition: Warning message:
   In FUN(c("1.txt", "2.txt")[[1L]], ...) :
   incomplete final line found by readTableHeader on '1.txt'
dict <- c(data)
#dict <- c("sky","blue","bright","sun") // original dictionary, want to replace this by above method
docs <- c(D1 = "The sky is blue.", D2 = "The sun is bright.", D3 = "The sun in the sky is bright.")
dd <- Corpus(VectorSource(docs))
dtm <- DocumentTermMatrix(dd, control = list(weighting = weightTfIdf,dictionary = dict))

我收到以下错误：

Error in sort.int(x, na.last = na.last, decreasing = decreasing, ...) : 
'x' must be atomic

有谁能告诉我，我做错了什么？

Answer 1

我认为您不应该将read.table用于那些不规则的数据文件。为什么不使用readLines()代替

txt_files <- list.files(pattern = '*.txt');
data <- lapply(txt_files, readLines)
dict <- gsub(",$","", unlist(data))

docs <- c(D1 = "The sky is blue.", D2 = "The sun is bright.", D3 = "The sun in the sky is bright.")
dd <- Corpus(VectorSource(docs))
dtm <- DocumentTermMatrix(dd, 
    control = list(weighting = weightTfIdf,dictionary = dict)) 

inspect(dtm)

请注意，我们必须使用此方法删除训练逗号，但这非常简单。

从多个txt文件创建语料库词汇表

1 个答案: