zillow api与R - XML问题

时间:2016-08-07 18:18:54

标签: r xml zillow

我正在尝试从Zillow API中读取信息并在R中遇到一些数据结构问题。我的输出应该是xml并且看起来像是,但是不像xml那样。

具体来说,GetSearchResults()返回给我的对象采用类似于XML的格式,但在R的XML读取函数中读取不太正确。

你能告诉我应该怎么做吗?

#set directory
setwd('[YOUR DIRECTORY]')

# setup libraries
library(dplyr)
library(XML)
library(ZillowR)
library(RCurl)

# setup api key
set_zillow_web_service_id('[YOUR API KEY]')

xml = GetSearchResults(address = '120 East 7th Street', citystatezip = '10009')
data = xmlParse(xml)

这会引发以下错误:

Error: XML content does not seem to be XML

Zillow API文档明确指出输出应该是XML,它看起来确实如此。我希望能够轻松访问API输出的各种组件,以进行更大规模的数据操作/聚合。如果您有任何想法,请告诉我。

3 个答案:

答案 0 :(得分:4)

这对我来说是一个了解Zillow API的有趣机会。在How to parse XML to R data frame之后,我的方法是将响应转换为列表,以便于检查。繁琐的一点是通过检查列表来确定数据的结构,特别是因为每个属性可能都有一些丢失的数据。这就是为什么我编写getValRange函数来处理解析Zestimate数据的原因。

results <- xmlToList(xml$response[["results"]])

getValRange <- function(x, hilo) {
  ifelse(hilo %in% unlist(dimnames(x)), x["text",hilo][[1]], NA)
}

out <- apply(results, MAR=2, function(property) {
  zpid <- property$zpid
  links <- unlist(property$links)
  address <- unlist(property$address)
  z <- property$zestimate
  zestdf <- list(
    amount=ifelse("text" %in% names(z$amount), z$amount$text, NA),
    lastupdated=z$"last-updated",
    valueChange=ifelse(length(z$valueChange)==0, NA, z$valueChange),
    valueLow=getValRange(z$valuationRange, "low"),
    valueHigh=getValRange(z$valuationRange, "high"),
    percentile=z$percentile)  
  list(id=zpid, links, address, zestdf)
})

data <- as.data.frame(do.call(rbind, lapply(out, unlist)), 
  row.names=seq_len(length(out)))

示例输出:

> data[,c("id", "street", "zipcode", "amount")]
          id              street zipcode  amount
1 2098001736 120 E 7th St APT 5A   10009 2321224
2 2101731413 120 E 7th St APT 1B   10009 2548390
3 2131798322 120 E 7th St APT 5B   10009 2408860
4 2126480070 120 E 7th St APT 1A   10009 2643454
5 2125360245 120 E 7th St APT 2A   10009 1257602
6 2118428451 120 E 7th St APT 4A   10009    <NA>
7 2125491284 120 E 7th St FRNT 1   10009    <NA>
8 2126626856 120 E 7th St APT 2B   10009 2520587
9 2131542942 120 E 7th St APT 4B   10009 1257676

答案 1 :(得分:2)

# setup libraries
pacman::p_load(dplyr,XML,ZillowR,RCurl) # I use pacman, you don't have to

# setup api key
set_zillow_web_service_id('X1-mykey_31kck')

xml <- GetSearchResults(address = '120 East 7th Street', citystatezip = '10009')
dat <- unlist(xml)
str(dat)
  

命名为chr [1:653]&#34; 120 East 7th Street&#34; &#34; 10009&#34; &#34;请求成功   处理&#34; &#34; 0&#34; &#34;响应&#34; &#34;结果&#34; &#34;导致&#34; &#34; zpid&#34; &#34;文本&#34;   &#34; 2131798322&#34; &#34;链接&#34; ...     - attr(*,&#34; names&#34;)= chr [1:653]&#34; request.address&#34; &#34; request.citystatezip&#34; &#34; message.text&#34; &#34; message.code&#34; ...

dat <- as.data.frame(dat)
dat <- gsub("text","", dat$dat)

我不确定你想对这些结果做些什么,但他们在那里看起来很好看:

head(dat, 20)
 [1] "120 East 7th Street"                                                                     
 [2] "10009"                                                                                   
 [3] "Request successfully processed"                                                          
 [4] "0"                                                                                       
 [5] "response"                                                                                
 [6] "results"                                                                                 
 [7] "result"                                                                                  
 [8] "zpid"                                                                                    
 [9] ""                                                                                        
[10] "2131798322"                                                                              
[11] "links"                                                                                   
[12] "homedetails"                                                                             
[13] ""                                                                                        
[14] "http://www.zillow.com/homedetails/120-E-7th-St-APT-5B-New-York-NY-10009/2131798322_zpid/"
[15] "mapthishome"                                                                             
[16] ""                                                                                        
[17] "http://www.zillow.com/homes/2131798322_zpid/"                                            
[18] "comparables"                                                                             
[19] ""                                                                                        
[20] "http://www.zillow.com/homes/comps/2131798322_zpid/"

答案 2 :(得分:1)

如前所述,诀窍是将API放入列表(而不是XML)。然后,提取您感兴趣的任何数据变得非常简单。

我写了一个R包来简化这个。看看github - https://github.com/billzichos/homer。它带有一个小插图。

假设您感兴趣的属性的Zillow ID是36086728,代码看起来像。

home_estimate("36086728")