Python脚本数据库连接为Pool不起作用,但简单连接有效

时间:2019-04-12 12:23:54

标签: mysql python-3.x tornado pool

我正在用python 3编写一个脚本,该脚本正在侦听隧道并根据收到的消息在MySQL内部保存和更新数据。

我进入了一个奇怪的行为,我使用 pymysql 模块与MySQL进行了简单的连接,但一切正常,但有时这个简单的连接关闭了。

因此,我决定实现与MySQL的池连接,从而出现问题。发生任何事情都没有错误,但是问题出在以下地方:

我的光标= 产生self._pool.execute(query,list(filters.values()))

光标结果= tornado_mysql.pools.Pool对象位于0x0000019DE5D71F98

,然后像这样堆叠堆栈

如果我从光标中删除了 yield ,则该行通过,而下一行则抛出错误

响应= 产生c.fetchall()

AttributeError:“ Future”对象没有属性“ fetchall”

如何修复MySQL池连接以使其正常工作?

我尝试过的事情:

  1. 我使用很少的模块进行池连接,所有模块都存在相同的问题

  2. 与pymysql进行了简单的连接,并再次工作了

我的代码下方:

python脚本文件

import pika
from model import SyncModel

_model = SyncModel(conf, _server_id)

@coroutine
def main():
    credentials = pika.PlainCredentials('user', 'password')

    try:
        cp = pika.ConnectionParameters(
            host='127.0.0.1',
            port=5671,
            credentials=credentials,
            ssl=False,
        )

        connection = pika.BlockingConnection(cp)
        channel = connection.channel()

        @coroutine
        def callback(ch, method, properties, body):
            if 'messageType' in properties.headers:
                message_type = properties.headers['messageType']
                if message_type in allowed_message_types:
                    result = ptoto_file._reflection.ParseMessage(descriptors[message_type], body)
                    if result:
                        result = protobuf_to_dict(result)
                        if message_type == 'MyMessage':
                            yield _model.message_event(data=result)


                else:
                    print('Message type not in allowed list = ' + str(message_type))
                    print('continue listening...')

        channel.basic_consume(callback, queue='queue', no_ack=True)

        print(' [*] Waiting for messages. To exit press CTRL+C')
        channel.start_consuming()
    except Exception as e:
        print('Could not connect to host 127.0.0.1 on port 5671')
        print(str(e))


if __name__ == '__main__':
    main()

SyncModel

from tornado_mysql import pools  
from tornado.gen import coroutine, Return
from tornado_mysql.cursors import DictCursor 

class SyncModel(object):
    def __init__(self, conf, server_id):
        self.conf = conf
        servers = [i for i in conf.mysql.servers]

        for s in servers:
            if s['server_id'] == server_id:
                // s hold all data as, host, user, port, autocommit, charset, db, password
                s['cursorclass'] = DictCursor                
                self._pool = pools.Pool(s, max_idle_connections=1, max_recycle_sec=3)

    @coroutine
    def message_event(self, data):
        table_name = 'table_name'
        query = ''
        data = data['message']

        filters = {
            'id': data['id']
        }

        // here the connection fails as describe above
        response = yield self.query_select(table_name, self._pool, filters=filters)


    @coroutine
    def query_select(self, table_name, _pool, filters=None):
        if filters is None:
            filters = {}

        combined_filters = ['`%s` = %%s' % i for i in filters.keys()]
        where = 'WHERE ' + ' AND '.join(combined_filters) if combined_filters else ''
        query = """SELECT * FROM `%s` %s""" % (table_name, where)
        c = self._pool.execute(query, list(filters.values()))

        response = yield c.fetchall()

        raise Return({response})

在我开始使用池示例后,所有代码仅通过与数据库的简单连接即可正常工作。感谢您在此问题上的任何帮助。

这是一个独立的脚本。

1 个答案:

答案 0 :(得分:0)

池连接无法正常工作,因此请仔细检查连接是否切换回pymysql

我想发布有效的答案,只有此解决方案对我有用

  1. 在连接到mysql之前检查连接是否打开,如果没有重新连接

    if not self.mysql.open:
        self.mysql.ping(reconnect=True)