使用Wiki中的beautifulsoup提取数据

Question

我对此很陌生，

我要完成的工作是创建一个包含Distrcits及其各个邻域的表，但是我的最终代码只是以列表格式列出了所有邻域，而没有将它们分配给特定的地区。

url = "https://en.wikipedia.org/wiki/List_of_neighbourhoods_in_Toronto"
html = urlopen(url) 
soup = BeautifulSoup(html, 'lxml')
type(soup)
print(soup.prettify())
Toronto_table = soup.find('table',{'class':'wikitable sortable'})
links = Toronto_table.find_all('a')
neighborhoods = []
for link in links:
    neighborhoods.append(link.get('title'))
    print(neighborhoods)
df_neighborhoods = pd.DataFrame(neighborhoods)
df_neighborhoods

Answer 1

您只需阅读HTML并打印表格即可。

import pandas as pd
f_states=pd.read_html('https://en.wikipedia.org/wiki/List_of_neighbourhoods_in_Toronto')
print(f_states[6])

输出：

 District Number                            Neighbourhoods Included
0              C01  Downtown, Harbourfront, Little Italy, Little P...
1              C02  The Annex, Yorkville, South Hill, Summerhill, ...
2              C03  Forest Hill South, Oakwood–Vaughan, Humewood–C...
3              C04  Bedford Park, Lawrence Manor, North Toronto, F...
4              C06           North York, Clanton Park, Bathurst Manor
5              C07  Willowdale, Newtonbrook West, Westminster–Bran...
6              C08  Cabbagetown, St. Lawrence Market, Toronto wate...
7              C09                               Moore Park, Rosedale
8              C10  Davisville Village, Midtown Toronto, Lawrence ...
9              C11         Leaside, Thorncliffe Park, Flemingdon Park
10             C13     Don Mills, Parkwoods–Donalda, Victoria Village
11             C14                  Newtonbrook East, Willowdale East
12             C15  Hillcrest Village, Bayview Woods – Steeles, Ba...
13             E01       Riverdale, Danforth (Greektown), Leslieville
14             E02                     The Beaches, Woodbine Corridor
15             E03  Danforth (Greektown), East York, Playter Estat...
16             E04  The Golden Mile, Dorset Park, Wexford, Maryval...
17             E05      Steeles, L'Amoreaux, Tam O'Shanter – Sullivan
18             E06        Birch Cliff, Oakridge, Hunt Club, Cliffside
19             E08  Scarborough Village, Cliffcrest, Guildwood, Eg...
20             E09  Scarborough City Centre, Woburn, Morningside, ...
21             E10  Rouge (South), Port Union (Centennial Scarboro...
22             E11                              Rouge (West), Malvern
23             W01  High Park, South Parkdale, Swansea, Roncesvall...
24             W02  Bloor West Village, Baby Point, The Junction (...
25             W03  Keelesdale, Eglinton West, Rockcliffe–Smythe, ...
26             W04  York, Glen Park, Amesbury (Brookhaven), Pelmo ...
27             W05  Downsview, Humber Summit, Humbermede (Emery), ...
28             W06        New Toronto, Long Branch, Mimico, Alderwood
29             W07              Sunnylea (The Queensway – Humber Bay)
30             W08  The Kingsway, Central Etobicoke, Eringate – Ce...
31             W09  Kingsview Village-The Westway, Richview (Willo...
32             W10  Rexdale, Clairville, Thistletown - Beaumond He...