Question

我有一个芹菜工作者，包括在远程机器上运行木偶代理的任务，这是一个阻塞呼叫。我还有其他可以从eventlet中受益的其他任务的http api流程

@app.task(soft_time_limit=600)
def run_puppet_agent(hostname):
    try:
        env.host_string = self.host
        env.user = self.username
        env.password = self.password
        return sudo('puppet agent -t')
    except SoftTimeLimitExceeded:
        raise Exception('Puppet agent TIMED OUT AFTER 600 seconds')
    except Exception as e:
        #run_puppet_agent.retry(args=[hostname], countdown=20)
        LOG.info('')
        raise Exception('Puppet agent failed with error message %s' % e.message)

当我以

运行工作人员时

celery multi start 2 -A phantom.celery.manage -P eventlet -c 15 --loglevel=INFO

它给我一个例外跟踪如下：

Traceback (most recent call last):
File "/home/uruddarraju/Phantom/phantom/tasks/fabric_tasks.py", line 19, in run_puppet_agent
return sudo(command, quiet=False)
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/fabric/network.py", line 639, in host_prompting_wrapper
return func(*args, **kwargs)
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/fabric/operations.py", line 1095, in sudo
stderr=stderr, timeout=timeout, shell_escape=shell_escape,
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/fabric/operations.py", line 911, in _run_command
stderr=stderr, timeout=timeout)
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/fabric/operations.py", line 795, in _execute
worker.raise_if_needed()
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/fabric/thread_handling.py", line 12, in wrapper
callable(*args, **kwargs)
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/fabric/io.py", line 231, in input_loop
r, w, x = select([sys.stdin], [], [], 0.0)
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/eventlet/green/select.py", line 79, in select
listeners.append(hub.add(hub.READ, k, on_read))
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/eventlet/hubs/epolls.py", line 52, in add
self.register(fileno, new=True)
File "/home/uruddarraju/Phantom/tools/virtualenv/local/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 45, in register
self.poll.register(fileno, mask)
IOError: [Errno 1] Operation not permitted

我已阅读：Why does select.select() work with disk files but not epoll()?并且看到有一个问题，即eventlet使用结构或此类阻塞调用。有没有办法告诉芹菜不要修补这个特殊的任务？

Answer 1

当我使用gevent时，这个错误得到了缓解。我希望它能为我带来同样的表现。

python eventlet fabric给出IOError：[Errno 1]运行celery worker时不允许操作

1 个答案: