Question

import requests
from bs4 import BeautifulSoup
import pandas as pd
import matplotlib.pyplot as plt

plt.style.use('ggplot')


url = "https://www.google.com/finance/historical?cid=207437&startdate=Jan%201%2C%201971&enddate=Jul%201%2C%202017&start={0}&num=30"
how_many_pages=3
start=0

for i in range(how_many_pages):
    new_url = url.format(start)
    page = requests.get(new_url)
    soup = BeautifulSoup(page.content, "lxml")
    table = soup.find_all('table', class_='gf-table historical_price')[0]

    columns_header = [th.getText() for th in table.findAll('tr')[0].findAll('th')]
    data_rows=table.findAll('tr')[1:]
    data=[[td.getText() for td in data_rows[i].findAll(['td'])] for i in range(len(data_rows))]

    if start == 0:
        final_df = pd.DataFrame(data, columns=columns_header)
    else:
        df = pd.DataFrame(data, columns=columns_header)
        final_df = pd.concat([final_df, df],axis=0)
    start += 30
    final_df.to_csv('nse_data.csv', sep='\t', encoding='utf-8')


final_df.columns = ['Date']
final_df['Date'] = pd.to_datetime(df['Date'], format='%Y-%m-%d', utc=True)


df.plot(x='Date', y='Close')


plt.savefig('foo.png')

下载的数据采用以下格式

    "Date
"   "Open
"   "High
"   "Low
"   "Close
"   "Volume
"
0   "Jun 30, 2017
"   "9,478.50
"   "9,535.80
"   "9,448.75
"   "9,520.90
"   "-
"
1   "Jun 29, 2017
"   "9,522.95
"   "9,575.80
"   "9,493.80
"   "9,504.10
"   "-

暂时我只想在Date（在Y轴上）Close（在X轴上）

但是我收到了错误

ValueError: Length mismatch: Expected axis has 6 elements, new values have 1 elements

Answer 1

您的标题和数据包含换行符。 print(final_df.columns)返回：

Index(['Date\n', 'Open\n', 'High\n', 'Low\n', 'Close\n', 'Volume\n'], dtype='object')

使用rstrip摆脱它们：

columns_header = [th.getText().rstrip() for th in table.findAll('tr')[0].findAll('th')]

和

data = [[td.getText().rstrip() for td in data_rows[i].findAll(['td'])] for i in range(len(data_rows))]

final_df.columns = ['Date']会产生错误。数据框需要与其列数一样多的标头。因此，在您的情况下，预计会有6个元素的列表。我不确定你想在这做什么，我想你可以简单地删除这一行。
您为日期解析指定的格式与您的数据['Apr 4, 2017', 'Apr 5, 2017', 'Apr 6, 2017',...]不匹配。有关format codes here的文档。改为使用：
```
final_df['Date'] = pd.to_datetime(df['Date'], format='%b %d, %Y')
```

将数据转换为数值，以便绘制它们：

final_df['Close'] = [float(val.replace(',', '')) for val in final_df['Close']]

最后你可以打电话：
```
final_df.plot(x='Date', y='Close')
```

ValueError：长度不匹配：预期轴有6个元素，新值有1个元素

1 个答案: