具有超时的多个子进程

时间:2011-07-01 21:31:40

标签: python signals

我正在使用依赖SIGALRM设置闹钟中断的配方 - Using module 'subprocess' with timeout

问题是我有多个Python脚本使用signal.ALARM进程来设置超时,并且只调用最新的警报。有什么好方法可以改善这些多个Python函数设置超时?

1 个答案:

答案 0 :(得分:11)

除了简单快速的黑客攻击外,请避免使用SIGALRM。这是一个非常古老的,有限的机制,不适用于任何更复杂的事情:你只能设置一个警报,它会中断任何系统调用,而不仅仅是你打算中断的系统调用。

使用超时线程来终止进程要简单得多,例如:

import subprocess, signal, os, threading, errno
from contextlib import contextmanager

class TimeoutThread(object):
    def __init__(self, seconds):
        self.seconds = seconds
        self.cond = threading.Condition()
        self.cancelled = False
        self.thread = threading.Thread(target=self._wait)

    def run(self):
        """Begin the timeout."""
        self.thread.start()

    def _wait(self):
        with self.cond:
            self.cond.wait(self.seconds)

            if not self.cancelled:
                self.timed_out()

    def cancel(self):
        """Cancel the timeout, if it hasn't yet occured."""
        with self.cond:
            self.cancelled = True
            self.cond.notify()
        self.thread.join()

    def timed_out(self):
        """The timeout has expired."""
        raise NotImplementedError

class KillProcessThread(TimeoutThread):
    def __init__(self, seconds, pid):
        super(KillProcessThread, self).__init__(seconds)
        self.pid = pid

    def timed_out(self):
        try:
            os.kill(self.pid, signal.SIGKILL)
        except OSError as e:
            # If the process is already gone, ignore the error.
            if e.errno not in (errno.EPERM, errno. ESRCH):
                raise e

@contextmanager
def processTimeout(seconds, pid):
    timeout = KillProcessThread(seconds, pid)
    timeout.run()
    try:
        yield
    finally:
        timeout.cancel()


def example():
    proc = subprocess.Popen(["sleep", "5"], stdin=subprocess.PIPE, stdout=subprocess.PIPE)

    with processTimeout(1, proc.pid):
        print proc.communicate()

    resultcode = proc.wait()
    if resultcode < 0:
        print "error: %i" % resultcode

if __name__ == '__main__':
    example()

根据您的超时情况,您可能希望使用比SIGKILL更轻的信号,以允许超时过程自行清理。