限制传出PHP + curl请求

时间:2012-09-10 19:43:26

标签: php api curl limit

有没有办法将传出的PHP + curl请求限制(延迟)到外部服务器,这样每秒只有n个请求? PHP用于Fastcgi模式,因此无法使用睡眠。

2 个答案:

答案 0 :(得分:1)

是。有卷曲多处理程序......

(您可以使用this library

以OOP方式进行

例如:

    // Creates the curl multi handle
    $mh = curl_multi_init();
    $handles = array();

    foreach($urls as $url)
    {
        // Create a new single curl handle
        $ch = curl_init();

        // Set options
        curl_setopt($ch, CURLOPT_URL, $url);
        curl_setopt($ch, CURLOPT_HEADER, 0);
        curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
        curl_setopt($ch, CURLOPT_TIMEOUT, 300);

        // Add to the multi handle
        curl_multi_add_handle($mh,$ch);

        // Put the handles in an array to loop this later on
        $handles[] = $ch;
    }

    // Execute the multi handle
    $running=null;

    do
    {
        $mrc = curl_multi_exec($mh,$running);

        // Added a usleep for 0.50 seconds to reduce load
        usleep (250000);
    }
    while($running > 0);

    // Get the content of the urls (if there is any)
    $output = array();
    for($i=0; $i<count($handles); $i++)
    {
        // Get the content of the handle
        $content = curl_multi_getcontent($handles[$i]);
        $output[] = $content;

        if($printOutput) {
            echo $content;
        }

        // Remove the handle from the multi handle
        curl_multi_remove_handle($mh,$handles[$i]);
    }

    // close the multi curl handle to free system resources
    curl_multi_close($mh);

答案 1 :(得分:1)

您可以使用token bucket algorithm控制费率。由于您希望控制一个资源的所有PHP进程的速率,因此您需要共享存储桶的状态。您可以通过我的实现以线程安全的方式执行此操作:bandwidth-throttle/token-bucket

use bandwidthThrottle\tokenBucket\Rate;
use bandwidthThrottle\tokenBucket\TokenBucket;
use bandwidthThrottle\tokenBucket\BlockingConsumer;
use bandwidthThrottle\tokenBucket\storage\FileStorage;

$storage  = new FileStorage(__DIR__ . "/api.bucket");
$rate     = new Rate(10, Rate::SECOND);
$bucket   = new TokenBucket(10, $rate, $storage);
$consumer = new BlockingConsumer($bucket);
$bucket->bootstrap(10);

// This blocks all processes to the rate of 10 requests/second
$consumer->consume(1);

$api->doSomething();