如何从laravel作业中运行有限数量的后台进程?

时间:2019-06-12 20:20:50

标签: laravel jobs que

我想从laravel作业中运行ffmpeg进程,但一次不要太多。我似乎无法正确解决。无论我为$ process_limit设置什么,它一次只能运行一个,并且它们之间会有很长的延迟。也许我在使用公共$ timeout错误。也许是retryUntil()。我不知道。

<?php

namespace FuquIo\LaravelFfmpeg;

use Cocur\BackgroundProcess\BackgroundProcess;
use Illuminate\Bus\Queueable;
use Illuminate\Queue\SerializesModels;
use Illuminate\Queue\InteractsWithQueue;
use Illuminate\Contracts\Queue\ShouldQueue;
use Illuminate\Foundation\Bus\Dispatchable;
use Illuminate\Support\Facades\Log;
use Illuminate\Support\Facades\Redis;

class RenderMpeg4ToWebmJob implements ShouldQueue{
use Dispatchable, InteractsWithQueue, Queueable;

public $timeout = 3600;

/**
 * @var string
 */
private $input_file;
/**
 * @var array
 */
private $map;

/**
 * Create a new job instance.
 *
 * @param array  $map
 * @param string $input_file
 */
public function __construct(array $map, string $input_file){
    //
    $this->map        = $map;
    $this->input_file = $input_file;
}

/**
 * Execute the job.
 *
 * @return void
 * @throws \Exception
 */
public function handle(){

    $almost_timeout = $this->timeout - 100;
    $map            = $this->map;
    $input_file     = $this->input_file;

    $cmds = '(' . implode('; ', config('fuqu-ffmpeg.command')) . ')';
    $cmds = str_replace(array_keys($map), array_values($map), $cmds);

    Log::debug($cmds);

    $process_limit = config(ServiceProvider::SHORT_NAME .'.process_limit');
    Redis::funnel('ffmpeg')->limit($process_limit)->then(
        function () use ($cmds, $input_file, $almost_timeout){

            $process = new BackgroundProcess($cmds);
            $process->run();

            if(!$process->isRunning()){
                throw new \Exception('Unable to execute file processing command on ' . $input_file);
            }

            /**
             * This doesn't prevent an additional
             * background process from spawning
             * but it does give a head start
             */
            $slept = 0;
            do{
                sleep(10);
                $slept += 10;
            }while($process->isRunning() and ($slept < $almost_timeout));

        }, function (){
        // Could not obtain lock...

        return $this->release(100);
    });


}

/**
 * Rather than doing x tries,
 * just keep trying until.
 *
 * @return \DateTime
 */
public function retryUntil(){
    return now()->addDays(1);
}

}

1 个答案:

答案 0 :(得分:0)

事实证明问题中的代码确实有效。我的问题是在bg进程中。以数字结尾的文件遇到了麻烦。我猜我会保留代码...对某人可能有用。