偶尔“连接错误:无法连接到数据库”到mongo

时间:2011-03-13 05:19:27

标签: django mongodb pymongo

我们目前正在测试一个基于django的项目,该项目使用MongoEngine作为持久层。 MongoEngine基于pymongo,我们使用的是1.6版,我们正在运行mongo的单实例设置。

我们注意到的是,偶尔会有大约5分钟的连接无法与mongo实例建立连接。有人遇到过这种行为吗?关于如何提高可靠性的任何提示?

2 个答案:

答案 0 :(得分:2)

我们遇到AutoReconnect的问题,听起来与您所描述的类似。我最终在我的<project>/__init__.py文件中修改了pymongo:

from pymongo.cursor import Cursor                                                             
from pymongo.errors import AutoReconnect                                                      

from time import sleep                                                                        
import sys                                                                                    

AUTO_RECONNECT_ATTEMPTS = 10                                                                  
AUTO_RECONNECT_DELAY = 0.1                                                                    

def auto_reconnect(func):                                                                     
    """                                                                                       
    Function wrapper to automatically reconnect if AutoReconnect is raised.                   

    If still failing after AUTO_RECONNECT_ATTEMPTS, raise the exception after                 
    all. Technically this should be handled everytime a mongo query is                        
    executed so you can gracefully handle the failure appropriately, but this                 
    intermediary should handle 99% of cases and avoid having to put                           
    reconnection code all over the place.                                                     

    """                                                                                       
    def retry_function(*args, **kwargs):                                                      
        attempts = 0                                                                          
        while True:                                                                           
            try:                                                                              
                return func(*args, **kwargs)                                                  
            except AutoReconnect, e:                                                          
                attempts += 1                                                                 
                if attempts > AUTO_RECONNECT_ATTEMPTS:                                        
                    raise                                                                     
                sys.stderr.write(                                                             
                    '%s raised [%s] -- AutoReconnecting (#%d)...\n' % (                       
                        func.__name__, e, attempts))                                          
                sleep(AUTO_RECONNECT_DELAY)                                                   
    return retry_function                                                                     

# monkeypatch: wrap Cursor.__send_message (name-mangled)                                      
Cursor._Cursor__send_message = auto_reconnect(Cursor._Cursor__send_message)                   
# (may need to wrap some other methods also, we'll see...) 

这解决了我们的问题,但你可能会描述不同的东西?

答案 1 :(得分:1)

这是另一个使用子类而不是猴子修补的解决方案,并处理在建立初始连接或访问数据库时可能引发的错误。我只是将Connection / ReplicasetConnection子类化,并在实例化和任何方法调用期间处理引发的AutoReconnect错误。您可以在构造函数中指定重试次数和重试次数之间的休眠时间。

您可以在此处查看要点:https://gist.github.com/2777345