pyppeteer.errors.TimeoutError:超出导航超时:超过8000 ms

时间:2020-08-30 01:26:42

标签: python web-scraping

运行以下代码时出现错误。这是我用于网页抓取。

          string connection_str="";
           MySqlConnection con = new MySqlConnection(connection_str);
            con.Open();

            string command = "command test";

             MySqlDataAdapter cmd = new MySqlDataAdapter(command, con);
          
            DataTable dt_imgs = New Datatable();
            cmd.Fill(dt_imgs);
           
          //the fixed part
           for (int i = 1; i < dt_imgs.Rows.Count; i++)
            {
                
                string filename = "C:\files\image"+i.ToString()+".jpg";
                 
                byte[] ImagemByte = (byte[])dt_imgs.Rows[i][3];
                File.WriteAllBytes(filename, ImagemByte);
            }

我收到以下错误

from requests_html import HTMLSession

url = 'https://www.beerwulf.com/en-gb/c/beers?segment=Beers&catalogCode=Beer_1'

s = HTMLSession()
r = s.get(url)

r.html.render(sleep=1) 
print(r.status_code)

1 个答案:

答案 0 :(得分:3)

r.html.render()的默认超时为8秒。如果未在8秒内加载所有JavaScript代码,则会出现此错误。您可以通过更改默认超时(例如20秒)来解决此问题。使用以下代码:

r.html.render(timeout = 20)