如何解决此网络抓取问题

时间:2020-04-30 00:28:25

标签: r rvest

我正在尝试在R中抓取网页。

page <- read_html("https://www.imdb.com/chart/top/") 
header_nodes <- html_nodes(page, css = ".titleColumn a" )
rating_nodes <- html_nodes(page, css = "strong")

我正在尝试提取电影的标题和等级,但出现此错误:

inDL(x,as.logical(local),as.logical(now),...)中的错误:ICU初始化失败:U_FILE_ACCESS_ERROR

1 个答案:

答案 0 :(得分:3)

尝试使用此:

library(rvest)
url <- 'https://www.imdb.com/chart/top/'
webpage <- url %>% read_html()

title <- webpage %>% html_nodes('td.titleColumn a') %>% html_text()
title

#[1] "The Shawshank Redemption"                                            
#[2] "The Godfather"                                                       
#[3] "The Godfather: Part II"                                              
#[4] "The Dark Knight"                                                     
#[5] "12 Angry Men"                                                        
#[6] "Schindler's List"                                                    
#[7] "The Lord of the Rings: The Return of the King"             
#...

获得评分:

ratings <- webpage %>% 
            html_nodes('td.ratingColumn strong') %>% 
            html_text() %>% as.numeric()
ratings
#[1] 9.2 9.1 9.0 9.0 8.9 8.9 8.9 .....