可取消的后端调用的体系结构建议[如果可能,请添加zerorpc?

时间:2019-07-09 18:43:11

标签: python http architecture electron zerorpc

我有一个电子应用程序前端(zerorpc节点)与需要进行以下操作的python后端(zerorpc-python)通信:

a)能够将请求发送到后端[标准zerorpc调用]

b)能够同时运行多个后端进程[遵循https://github.com/0rpc/zerorpc-node/issues/96中的架构)

c)能够随意取消后端进程[不确定如何使用当前架构进行操作]

关于如何为(c)构建解决方案的任何指导都将是很棒的。如果有必要的话,我愿意放弃zerorpc,但是如果解决方案涉及使用zerorpc,那就太好了。

1 个答案:

答案 0 :(得分:0)

我最终使用gipc加速了进程。取消机制取决于以下事实:gipc进程终止时,管道关闭。整个API都很复杂,这就是我最终得到的结果:

class ZerorpcService():
    def __init__(self):
        self.participant_id = None
        self.extraction_methods = []
        # maps pid to (process, pipe writer)
        self.processes = {}
        self. = lock.Semaphore()

    def _launch_process(self, function, kwargs):
        """
        Launches a new process
        """
        try:
            # add required arguments
            pid = kwargs["pid"]

            # start independent gipc process, communicated via pipe
            started = False
            with gipc.pipe() as (r, w):
                with self.mutex:
                    if pid in self.processes:
                        return_value = {'status': 1, 'error': 'pid already exists', "report": True}
                        return
                    proc = gipc.start_process(self._process_wrapper, args=(function, kwargs, w))
                    self.processes[pid] = proc
                    started = True
                # wait for process to send something over pipe
                return_value = r.get()
        except EOFError as eof:
            # happens when we terminate a process because the pipe closes
            return_value = {'status': 1, 'error': "pid {} terminated".format(pid), "report": False}
        except Exception as error:
            logging.exception(error)
            return_value = {'status': 1, 'error': str(error), 'traceback': traceback.format_exc(), "report": True}
        finally:
            # deletes the pid from the map
            with self.mutex:
                if started:
                    del self.processes[pid]
            return return_value

    @staticmethod
    def _process_wrapper(function, kwargs, pipe):
        """
        Executes f with kwargs and formats the result into a dict.
        Wraps it in error handling.
        Routes the return value through the pipe provided.
        """
        return_val = {'status': 0}
        try:
            raw_val = function(**kwargs)
            if raw_val is not None:
                return_val = raw_val
        except Exception as error:
            logging.exception(error)
            return_val = {'status': 1, 'error': str(error), 'traceback': traceback.format_exc(), "report": True}
        finally:
            pipe.put(return_val)

    def cancel_process(self, pid):
        if pid in self.processes:
            with self.mutex:
                process = self.processes[pid]
                if process.is_alive():
                    process.terminate()
                return {'status': 0}
        else:
            return {'status': 1, 'error': 'pid {} not found'.format(pid), "traceback": traceback.format_exc(),
                    "report": True}