Question

我无法从html表中提取数据（标记为tbody）。我非常希望在这里被证明是错误的。

这是我的代码：

import lxml.html as LH
import requests
import pandas as pd
from datetime import datetime

start_time = datetime.now()

def text(elt):
    return elt.text_content().replace(u'\xa0', u' ')

try:
    url = 'https://www.byma.com.ar/acciones/panel/general'
    r = requests.get(url)    
except requests.exceptions.Timeout as e:        
    print e
    sys.exit(1)
except requests.exceptions.TooManyRedirects as e:
    print e
    sys.exit(1)
except requests.exceptions.RequestException as e:    
    print e
    sys.exit(1)


root = LH.fromstring(r.content)

for table in root.xpath('//*[@id="dataStocks"]'):
    header = [text(th) for th in table.xpath('//*[@id="dataStocks"]/thead')]                
    data = [[text(td) for td in tr.xpath('//*[@id="dataStocks"]/tbody/tr')]
         for tr in table.xpath('//tr')]                   
    data = [row for row in data if len(row)==len(header)]     
    data = pd.DataFrame(data, columns=header)                
    print(data)

只有头列：S

Answer 1

您想要获取的值是初始页面源中不存在但从XHR接收的动态数据。您可以获得以下值：

import requests
import json

url = "https://www.byma.com.ar/wp-admin/admin-ajax.php?action=get_panel&panel_id=2"
response = requests.get(url)
data = response.json()

for entry in data["Cotizaciones"]:
    print(entry)

每个entry的输出类似于

{'Apertura': 8.5, 'Cantidad_Nominal_Compra': 17346, 
'Cantidad_Nominal_Venta': 21
569, 'Cantidad_Operaciones': '2409', 'Cierre_Anterior': 8.65, 'Denominacion': 'G
RUPO FINANCIERO VALORES SOCIEDAD ANONIMA', 'Estado': '', 'Ex': 'No', 'Hora_Cotiz
acion': '17:05:53', 'Maximo': 8.54, 'Minimo': 7.95, 'Monto_Operado_Pesos': 89376
607, 'Precio_Compra': 7.95, 'Precio_Promedio': 8.21, 'Precio_Promedio_Ponderado'
: 8.1886, 'Precio_Venta': 7.96, 'Simbolo': 'VALO', 'Tendencia': 0, 'Tipo_Liquida
cion': 'Pesos', 'Ultimo': 7.96, 'Variacion': -7.98, 'Vencimiento': '48hs', 'Volu
men_Nominal': 10896556}

您还可以单独从entry获取每个值，例如

print(entry['Apertura'])

输出：

8.5

Python：使用xpath数据的scínghtml表

1 个答案: