Question

我正在使用多个Curl，并想知道如何处理错误。我想检查发生了哪个错误，如果是错误，超出速率限制我想在延迟一段时间后再次抓取该链接（sleep（））。我的问题是：“是否有可以为我执行此功能的内置功能，或者我是否需要收集阵列中的所有Url并再次运行它们？”

这就是我现在所拥有的：

<?php

$urls = array(  "https://API-URL.com",
                "https://API-URL.com",
                "https://API-URL.com",
                "https://API-URL.com",
                ...);

//create the multiple cURL handle
$mh = curl_multi_init();

//Number of elements in $urls
$nbr = count($urls);

// set URL and options
for($x = 0; $x < $nbr; $x++){

    // create both cURL resources
    $ch[$x] = curl_init();

    // set URL and other appropriate options
    curl_setopt($ch[$x], CURLOPT_URL, $urls[$x]);
    curl_setopt($ch[$x], CURLOPT_RETURNTRANSFER, true );
    curl_setopt($ch[$x], CURLOPT_SSL_VERIFYPEER, false);

    //add the two handles
    curl_multi_add_handle($mh,$ch[$x]);
}

//execute the handles
do {
    curl_multi_exec($mh, $running);
} while ($running);

for($x = 0; $x < $nbr; $x++){
    $result = curl_multi_getcontent($ch[$x]);

    $decoded = json_decode($result, true);

    //get info about the request
    $error = curl_getinfo($ch[$x], CURLINFO_HTTP_CODE);

    //error handling
    if($error != 200){

        $again[] = array("Url" => $urls[$x], "errornbr" => $error); 

    } else {

        // Here I do what ever I want with the data
    }

    curl_multi_remove_handle($mh, $ch[$x]);
    curl_close($ch[1]);
}

curl_multi_close($mh);
?>

Answer 1

在第二个for循环中，当你循环通过curl处理程序来检查每个curl处理程序返回的内容时，我希望，这种方法会回答你的问题

foreach ($ch as $key => $h) {

//This code is actually checking for any error that may occur, whatever that 
//error is you can handle it in the if-part of the condition. and save those 
//urls to the array $again to call them on a later stage.

if (curl_errno($h)) {

//this is how you will get complete information what did happened to the 
//curl handler. And why did it fail. All the inforation will be stored in //error_info.

 $again[] = array("Url" =>curl_getinfo($h, CURLINFO_EFFECTIVE_URL), "error_info" => curl_getinfo($h)); 

}
else{

//here you will handle the success scenario for each curl handler.

$responses[$key] = ['data' => curl_multi_getcontent($h)];
}

//remove curl handler as you are doing in the loop

}

Answer 2

对于多个手柄有 https://www.php.net/manual/en/function.curl-multi-info-read.php

因此错误检查（假设 http 连接）应该如下所示：

while ($a = curl_multi_info_read($mh))
{
  if ($b = $a['result'])
  {
    echo curl_strerror($b);# CURLE_* error
  }
  elseif (!($b = curl_getinfo($a['handle'], CURLINFO_RESPONSE_CODE)))
  {
    echo 'connection failed';
  }
  elseif ($b !== 200)
  {
    echo 'HTTP status is not 200 OK';
  }
}

将此代码视为现代 PHP 的伪代码（我没有测试这个确切的变体，但方案会起作用）。在添加到“multi”句柄的“easy”句柄上调用 curl_errno() 将返回 0，这不是错误。

多卷曲，错误处理

2 个答案: