我们目前正在测试一个基于django的项目,该项目使用MongoEngine作为持久层。 MongoEngine基于pymongo,我们使用的是1.6版,我们正在运行mongo的单实例设置。
我们注意到的是,偶尔会有大约5分钟的连接无法与mongo实例建立连接。有人遇到过这种行为吗?关于如何提高可靠性的任何提示?
答案 0 :(得分:2)
我们遇到AutoReconnect
的问题,听起来与您所描述的类似。我最终在我的<project>/__init__.py
文件中修改了pymongo:
from pymongo.cursor import Cursor
from pymongo.errors import AutoReconnect
from time import sleep
import sys
AUTO_RECONNECT_ATTEMPTS = 10
AUTO_RECONNECT_DELAY = 0.1
def auto_reconnect(func):
"""
Function wrapper to automatically reconnect if AutoReconnect is raised.
If still failing after AUTO_RECONNECT_ATTEMPTS, raise the exception after
all. Technically this should be handled everytime a mongo query is
executed so you can gracefully handle the failure appropriately, but this
intermediary should handle 99% of cases and avoid having to put
reconnection code all over the place.
"""
def retry_function(*args, **kwargs):
attempts = 0
while True:
try:
return func(*args, **kwargs)
except AutoReconnect, e:
attempts += 1
if attempts > AUTO_RECONNECT_ATTEMPTS:
raise
sys.stderr.write(
'%s raised [%s] -- AutoReconnecting (#%d)...\n' % (
func.__name__, e, attempts))
sleep(AUTO_RECONNECT_DELAY)
return retry_function
# monkeypatch: wrap Cursor.__send_message (name-mangled)
Cursor._Cursor__send_message = auto_reconnect(Cursor._Cursor__send_message)
# (may need to wrap some other methods also, we'll see...)
这解决了我们的问题,但你可能会描述不同的东西?
答案 1 :(得分:1)
这是另一个使用子类而不是猴子修补的解决方案,并处理在建立初始连接或访问数据库时可能引发的错误。我只是将Connection / ReplicasetConnection子类化,并在实例化和任何方法调用期间处理引发的AutoReconnect错误。您可以在构造函数中指定重试次数和重试次数之间的休眠时间。
您可以在此处查看要点:https://gist.github.com/2777345