gevent + redis-py:SystemError:在PyObject_Call中没有错误的NULL结果

时间:2013-04-10 11:17:19

标签: python python-2.7 redis gevent

我正在使用带有redvent和redvent的redis-py,我有自己的类EventBot,它继承自Greenlet。

在本课程的__init__方法中,我使用

初始化与redis的连接
self._redis = Client(serializer=serialization.JSON(), **self.REDIS_CONFIG)

有时当我尝试运行脚本时,会抛出SystemError: NULL result without error in PyObject_Call,但有时它会正常启动。我也尝试将redis初始化移到_run()方法,但它没有帮助。

这是我正在使用的简化类:

from gevent import monkey, Greenlet
monkey.patch_all()

from sleekxmpp import ClientXMPP
from redish import serialization
from redish.client import Client


class EventBot(ClientXMPP, Greenlet):
    REDIS_CONFIG = {
        'host': 'localhost',
        'port': 6379,
        'db': ""
    }

    def __init__(self, jid, password, redis_config=None):
        ClientXMPP.__init__(self, jid, password)
        Greenlet.__init__(self)

        # Redis init
        if redis_config is not None:
            self.REDIS_CONFIG.update(redis_config)
        self._redis = Client(serializer=serialization.JSON(), **self.REDIS_CONFIG)

        QUESTIONS_KEY = __name__ + '_questions'
        try:
            self._questions = self._redis[QUESTIONS_KEY]
        except KeyError:
            self._questions = self._redis[QUESTIONS_KEY] = {}

    ## Class simplified for better readability ##

    def _run(self):
        self.connect()
        self.process(block=False)

以下是完整的追溯:

Traceback (most recent call last):
  File "start.py", line 15, in <module>
    bot = EventBot('marie@xxx.com', 'XXXpasswordXXX')
  File "/tmp/sandbox/gmarie/gmarie/marie/eventbot.py", line 41, in __init__
    self._questions = self._redis[QUESTIONS_KEY]
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/redish/client.py", line 196, in __getitem__
    value = self.api.get(name)
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/redis/client.py", line 551, in get
    return self.execute_command('GET', name)
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/redis/client.py", line 360, in execute_command
    connection.send_command(*args)
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/redis/connection.py", line 301, in send_command
    self.send_packed_command(self.pack_command(*args))
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/redis/connection.py", line 283, in send_packed_command
    self.connect()
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/redis/connection.py", line 228, in connect
    sock = self._connect()
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/redis/connection.py", line 240, in _connect
    sock.connect((self.host, self.port))
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/gevent/socket.py", line 376, in connect
    wait_readwrite(sock.fileno(), event=self._rw_event)
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/gevent/socket.py", line 215, in wait_readwrite
    switch_result = get_hub().switch()
  File "/tmp/sandbox/gmarie/venv/lib/python2.7/site-packages/gevent/hub.py", line 164, in switch
    return greenlet.switch(self)
SystemError: NULL result without error in PyObject_Call
Exception KeyError: KeyError(21246672,) in <module 'threading' from '/usr/lib64/python2.7/threading.py'> ignored

非常感谢任何帮助。


修改

在Arch Linux中使用geventgreenlet系统软件包(python2-geventpython2-greenlet)时似乎修复了问题,但根据他们的PKGBUILD,没有进行额外的修补那里。 (geventgreenlet)有人可以解释使用pip安装时出了什么问题吗?

2 个答案:

答案 0 :(得分:6)

使用greenlet==0.4.0时,GCC 4.8似乎存在问题。

如果您没有旧的gcc或其他可用的编译器,则可以使用CFLAGS="-O0" pip install greenlet==0.4.0或编辑greenlet的setup.py并调整os.environ["CFLAGS"]来覆盖此问题。

其他解决方案可能是下载并使用二进制文件greenlet.so

答案 1 :(得分:0)

根据关于此主题的the GitHub issue,您还可以使用CFLAGS="-O2 -fno-tree-dominator-opts"来获得常规编译器优化,但不会出现段错误。