从网站上的列表中获取数据以优于VBA

Question

我正试图找到一种从yelp.com获取数据的方法

我有一个电子表格，其中有几个关键字和位置。我希望根据我的电子表格中已有的关键字和位置从yelp列表中提取数据。

我创建了以下代码，但它似乎得到了荒谬的数据而不是我正在寻找的确切信息。

我想获得公司名称，地址和电话号码，但我得到的只是一无所获。如果有人可以帮我解决这个问题。

Sub find()

Dim ie As Object
    Set ie = CreateObject("InternetExplorer.Application")
    With ie
        ie.Visible = False
        ie.Navigate "http://www.yelp.com/search?find_desc=boutique&find_loc=New+York%2C+NY&ns=1&ls=3387133dfc25cc99#start=10"
        ' Don't show window
    ie.Visible = False

    'Wait until IE is done loading page
    Do While ie.Busy
        Application.StatusBar = "Downloading information, lease wait..."
        DoEvents
    Loop

    ' Make a string from IE content
    Set mDoc = ie.Document
    peopleData = mDoc.body.innerText
    ActiveSheet.Cells(1, 1).Value = peopleData
End With

peopleData = "" 'Nothing
Set mDoc = Nothing
End Sub

Answer 1

如果您右键单击IE并执行View Source，则网站上提供的数据显然不属于文档.Body.innerText属性的一部分。我注意到动态提供的数据通常就是这种情况，对于大多数网络抓取来说，这种方法实在太简单了。

我在谷歌浏览器中打开它并检查元素以了解我真正想要的东西，以及如何使用DOM / HTML解析器找到它;您需要添加对Microsoft HTML Object Library的引用。

我认为你可以让它返回<DIV>标签的集合，然后在循环中检查那些带有If标准的类名。

我对原始答案进行了一些修改，这应该在新单元格中打印每条记录：

Option Explicit
Private Sub Sleep Lib "kernel32" (ByVal dwMilliseconds As Long)
Sub find()
'Uses late binding, or add reference to Microsoft HTML Object Library 
'  and change variable Types to use intellisense
Dim ie As Object 'InternetExplorer.Application
Dim html As Object 'HTMLDocument
Dim Listings As Object 'IHTMLElementCollection
Dim l As Object 'IHTMLElement
Dim r As Long
    Set ie = CreateObject("InternetExplorer.Application")
    With ie
        .Visible = False
        .Navigate "http://www.yelp.com/search?find_desc=boutique&find_loc=New+York%2C+NY&ns=1&ls=3387133dfc25cc99#start=10"
        ' Don't show window
        'Wait until IE is done loading page
        Do While .readyState <> 4
            Application.StatusBar = "Downloading information, Please wait..."
            DoEvents
            Sleep 200
        Loop
        Set html = .Document
    End With
    Set Listings = html.getElementsByTagName("LI") ' ## returns the list
    For Each l In Listings
        '## make sure this list item looks like the listings Div Class:
        '   then, build the string to put in your cell
        If InStr(1, l.innerHTML, "media-block clearfix media-block-large main-attributes") > 0 Then
            Range("A1").Offset(r, 0).Value = l.innerText
            r = r + 1
        End If
    Next

Set html = Nothing
Set ie = Nothing
End Sub