尝试循环遍历代码数组并从Web下载所有表

Question

我认为此代码段已接近正常运行，但它并未从其指向的网站下载数据。我正在尝试下载名为＆＃39; fs-table＆＃39;我想把每个＆fs-table＆＃39;在各个Excel工作表上。

# pip install -U multi-mechanize
import mechanize
mech = mechanize.Browser()
from mechanize import Browser
from BeautifulSoup import BeautifulSoup
from openpyxl import load_workbook
from openpyxl import Workbook

mech = Browser()

tckr = ['SBUX','MSFT','AAPL']
url = "https://finance.google.com/finance?q=NASDAQ:" + tckr + "&fstype=ii"
page = mech.open(url)
html = page.read()
soup = BeautifulSoup(html)
table = soup.find("fs-table", border=1)

url_list = [url + s for s in tckr]

for url in url_list:
    try:
        wb1 = Workbook()
        ws1 = wb1.active
        wb1 = load_workbook('C:/Users/Excel/Desktop/template.xlsx')
        wb1.create_sheet(tckr)
        with open('C:/Users/Excel/Desktop/today.csv', 'a', newline='') as f:   
            for row in table.findAll('tr')[1:]:
                col = row.findAll('td')
                rank = col[0].string
                artist = col[1].string
                album = col[2].string
                cover_link = col[3].img['src']
                record = (rank, artist, album, cover_link)
                print("|".join(record))

    except HTTPError:
        print("{} - not found".format(url))
    wb1.save('C:/Users/Excel/Desktop/template.xlsx') 

这是我正在尝试使用的网站。

现在，我收到此消息： ModuleNotFoundError：没有名为＆＃39; mechanize＆＃39;

的模块

但是，我已经安装了多机械化！

我正在使用Python 3.6.1; Spyder 3.2.4

Answer 1

试试这个。它将从该站点获取表格数据。

from bs4 import BeautifulSoup
import requests

URL = "https://finance.google.com/finance?q=NASDAQ:{}&fstype=ii"

def Get_Table(ticker):   
    response = requests.get(URL.format(ticker))
    soup = BeautifulSoup(response.text,"lxml")
    table = soup.select_one("#fs-table")
    for items in table.select(" tr"):
        data = [' '.join(item.text.split()) for item in items.select("th,td")]
        print(data)

if __name__ == '__main__':
    for tckr in ['SBUX','MSFT','AAPL']:
        Get_Table(tckr)

Answer 2

替换你的

from mechanize import Browser

通过

import mechanize

和你的

mech = Browser()

通过

mech = mechanize.Browser()

BTW，url =＆＃34; https://finance.google.com/finance?q=NASDAQ：＆＃34; + tckr +＆＃34;＆amp; fstype = ii＆＃34;，而tckr尚未定义。我对python的了解有限。