故意在python中创建一个孤儿进程

时间:2012-10-26 23:55:46

标签: python parallel-processing python-2.7 subprocess multiprocessing

我有一个名为MyScript的python脚本(基于RHEL的类似unix),它有两个函数,叫做A和B.我希望它们在不同的独立进程中运行(分离B和A):

  • 启动脚本MyScript
  • 执行功能A
  • 生成一个新进程,将数据从函数A传递给B
  • 当功能B运行时,继续功能A
  • 当功能A完成时,即使B仍在运行,也要退出MyScript

我认为我应该使用多处理来创建一个守护进程,但是documentation表明它不是正确的用例。所以,我决定产生一个子进程和子^ 2进程(孩子的孩子),然后强制孩子终止。虽然这种解决方法似乎有效,但看起来真的很难看。

你能帮我把它变成pythonic吗?子进程模块是否有一个可以在函数上运行的方法?示例代码如下。

import multiprocessing
import time
import sys
import os

def parent_child():
    p = multiprocessing.current_process()
    print 'Starting parent child:', p.name, p.pid
    sys.stdout.flush()
    cc = multiprocessing.Process(name='childchild', target=child_child)
    cc.daemon = False
    cc.start()
    print 'Exiting parent child:', p.name, p.pid
    sys.stdout.flush()

def child_child():
    p = multiprocessing.current_process()
    print 'Starting child child:', p.name, p.pid
    sys.stdout.flush()
    time.sleep(30)
    print 'Exiting child child:', p.name, p.pid
    sys.stdout.flush()

def main():
    print 'starting main', os.getpid()
    d = multiprocessing.Process(name='parentchild', target=parent_child)
    d.daemon = False
    d.start()
    time.sleep(5)
    d.terminate()
    print 'exiting main', os.getpid()

main()

1 个答案:

答案 0 :(得分:2)

以下是原始代码的随机版本,可将功能移至单个调用spawn_detached(callable)。即使程序退出,它也会使分离的进程保持运行:

import time
import os
from multiprocessing import Process, current_process

def spawn_detached(callable):
    p = _spawn_detached(0, callable)
    # give the process a moment to set up
    # and then kill the first child to detach
    # the second.
    time.sleep(.001)
    p.terminate()

def _spawn_detached(count, callable):
    count += 1
    p = current_process()
    print 'Process #%d: %s (%d)' % (count, p.name, p.pid)

    if count < 2:
        name = 'child'
    elif count == 2:
        name = callable.func_name
    else:
        # we should now be inside of our detached process
        # so just call the function
        return callable()

    # otherwise, spawn another process, passing the counter as well
    p = Process(name=name, target=_spawn_detached, args=(count, callable)) 
    p.daemon = False 
    p.start()
    return p

def operation():
    """ Just some arbitrary function """
    print "Entered detached process"
    time.sleep(15)
    print "Exiting detached process"


if __name__ == "__main__":
    print 'starting main', os.getpid()
    p = spawn_detached(operation)
    print 'exiting main', os.getpid()