BeautifulSoup元素输出到列表

时间:2019-06-05 21:24:30

标签: python html web-scraping beautifulsoup

我有一个使用BeautifulSoup的输出。

  1. 我需要将输出从'type''bs4.element.Tag'转换为列表,并将列表导出到名为 COLUMN_A

  2. 我希望我的输出停止在第14个元素(最后三个h2无用)

我的代码:

import requests
from bs4 import BeautifulSoup


url = 'https://www.planetware.com/tourist-attractions-/oslo-n-osl-oslo.htm'
url_get = requests.get(url)
soup = BeautifulSoup(url_get.content, 'html.parser')
attraction_place=soup.find_all('h2', class_="sitename")    

for attraction in attraction_place:
    print(attraction.text)
    type(attraction)

输出:

1  Vigeland Sculpture Park
2  Akershus Fortress
3  Viking Ship Museum
4  The National Museum
5  Munch Museum
6  Royal Palace
7  The Museum of Cultural History
8  Fram Museum
9  Holmenkollen Ski Jump and Museum
10  Oslo Cathedral
11  City Hall (Rådhuset)
12  Aker Brygge
13  Natural History Museum & Botanical Gardens
14  Oslo Opera House and Annual Music Festivals
Where to Stay in Oslo for Sightseeing
Tips and Tours: How to Make the Most of Your Visit to Oslo
More Related Articles on PlanetWare.com

我希望有一个类似

的列表
attraction=[Vigeland Sculpture Park, Akershus Fortress, ......]

非常感谢您。

3 个答案:

答案 0 :(得分:1)

new = []
count = 1
for attraction in attraction_place:
    while count < 15:
        text = attraction.text
        new.append(text)
        count += 1

答案 1 :(得分:1)

一种简便的好方法是获取照片的alt属性。这样可以得到纯文本输出,并且只有14个文本,而无需切片/索引。

from bs4 import BeautifulSoup
import requests

r = requests.get('https://www.planetware.com/tourist-attractions-/oslo-n-osl-oslo.htm')
soup = bs(r.content, 'lxml')
attractions = [item['alt'] for item in soup.select('.photo [alt]')]
print(attractions)

答案 2 :(得分:1)

您可以使用切片。

for attraction in attraction_place[:14]:
    print(attraction.text)
    type(attraction)