Question

我正在使用R抓取亚马逊客户评论，并且遇到了一个我希望有人可能对此有所了解的错误。

我注意到R无法从所有评论中抓取指定节点（通过使用SelectorGadget找到）。每次我运行脚本时，我都会检索不同的数量，但绝不是完整的。这是非常令人沮丧的，因为目标是抓取评论并将它们编译成csv文件，以后可以使用R操作。基本上，如果产品有200条评论，当我运行脚本时，有时我会得到150条评论，有时候会有75条评论。评论，等等 - 但不是整个200.这个问题似乎发生在我反复拼写之后。

我也遇到了一些超时错误，特别是＆＃34; open.connection错误（x，＆＃34; rb＆＃34;）：达到超时＆＃34;。

如何解决此问题以继续抓取？我是初学者，但非常感谢任何帮助或见解!!

 url <- "https://www.amazon.com/Match-Mens-Wild-Cargo-Pants/product-reviews/B009HLOZ9U/ref=cm_cr_arp_d_show_all?ie=UTF8&reviewerType=all_reviews&pageNumber="

N_pages <- 204
A <- NULL
for (j in 1: N_pages){
   pant <- read_html(paste0(url, j)) 
   B <- cbind(pant %>% html_nodes(".review-text") %>%     html_text()     )
   A <- rbind(A,B)
 }
tail(A)


print(j)

Answer 1

这不适合你吗？

将网址设为“https://www.amazon.com/Match-Mens-Wild-Cargo-Pants/product-reviews/B009HLOZ9U/ref=cm_cr_arp_d_paging_btm_2?ie=UTF8&reviewerType=avp_only_reviews&sortBy=recent&pageNumber=”

N_pages <- 204
A <- NULL
for (j in 1: N_pages){
  pant <- read_html(paste0(url, j)) 
  B <- cbind(pant %>% html_nodes(".review-text") %>%     html_text()     )
  A <- rbind(A,B)
}
tail(A)
        [,1]                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     
[1938,] "This is really a good item to get. Trendy, probably you can choose a different color, it fits good but I wouldn't say perfect."                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         
[1939,] "I don't write reviews for most products, but I felt the need to do so for these pants for a couple reasons.  First, they are great pants!  Solid material, well-made, and they fit great.  Second, I want to echo those who say you need to go up in size when you order.  I wear anywhere from 32-34, depending on the brand.  I ordered these in a 36 and they fit like a 33 or 34.  I really love the look and feel of these, and will be ordering more!"                                                                                                                                                            
[1940,] "I bought the green one before, it is good quality and looks nice, than I purchased the similar one, but the  khaki color, but received absolutely different product, different material. really disappointed."                                                                                                                                                                                                                                                                                                                                                                                                          
[1941,] "These pants are great!  I have been looking to update my wardrobe with a more edgy style; these cargo pants deliver on that.  Paired with some casual sneakers or a decent nubuck leather boot completes the look from the waist down.  The lazy-casual look is great when traveling, as are the many pockets.  I wore these pants on a recent day trip to NYC and traveled comfortably with essential items contained in the 8 pockets.  I placed a second order shortly after my first pair arrived because I like them so much.  Shipping and delivery is also fairly fast, considering these pants ship from China!"
[1942,] "Pants are awesome, just like the picture. The size runs small, so if you order them I would order them bigger than normal. I usually wear a 34inch waist because i dont like my pants snug, these pants fit more like a 32 inch waist.Other than that i love them!"                                                                                                                                                                                                                                                                                                                                                     
[1943,] "the good:Pants are made from the durable cotton that has a nice feel; have a lot of useful features and roomy well placed pockets; durable stitching.the bad:Pants will shrink and drier/hot water is not recommended. Would have been better if the cotton was pretreated to prevent shrinking. I would gladly gave up the belt if I wouldn't have to wary about how to wash these pants.the ugly:faux pocket with a zipper. useless feature. on my pair came with a bright gold zipper, unlike a silver in a picture."

刮刮亚马逊客户评论

1 个答案: