如何在龙卷风应用程序中传达RabbitMQ(Pika库)

时间:2013-07-09 02:51:57

标签: python rabbitmq tornado amqp pika

Pika库支持tornado适配器here是一个关于如何使用异步适配器发布消息的示例。

我想在龙卷风应用中使用pika,只是一个例子,我想把龙卷风请求数据放到RabbitMQ,但不知道怎么做。

两个问题不知道如何解决。

1 Pika使用龙卷风适配器有自己的ioloop,

self._connection = pika.SelectConnection(pika.URLParameters(self._url),  
                                         self.on_connection_open)  
self._connection.ioloop.start()

Tornado应用程序有自己的ioloop,

tornado.ioloop.IOLoop.instance().start()

如何组合这两个ioloop?

2 Pika示例一次又一次地发布相同的消息,但我想发布请求数据,如何将请求数据传递给发布方法?

2 个答案:

答案 0 :(得分:6)

在我搜索完全相同的内容时,我发现了blog post of Kevin Jing Qiu

我进一步使用了rabbitmq洞,为每个websocket提供了他自己的一组频道和队列。

我项目的摘录可以在下面找到。绑定到RabbitMQ的龙卷风应用程序包含以下部分:

  1. 将处理Web请求的Tornado应用程序。我在这里只看到长寿的websockets,但你也可以使用短暂的http请求。
  2. PikaClient Instance的(一)RabbitMQ连接
  3. 在触发open方法时定义其频道,队列和交换的Web连接。
  4. 现在,websocket连接可以通过on_message从龙卷风(来自浏览器的数据)接收数据并将其发送到RabbitMQ。

    websocket连接将通过basic_consume从RabbitMQ接收数据。

    这不是完全正常的,但你应该明白这一点。

    class PikaClient(object):
    
        def __init__(self, io_loop):
            logger.info('PikaClient: __init__')
            self.io_loop = io_loop
    
            self.connected = False
            self.connecting = False
            self.connection = None
            self.channel = None
            self.message_count = 0
        """ 
        Pika-Tornado connection setup
        The setup process is a series of callback methods.
        connect:connect to rabbitmq and build connection to tornado io loop -> 
        on_connected: create a channel to rabbitmq ->
        on_channel_open: declare queue tornado, bind that queue to exchange 
                         chatserver_out and start consuming messages. 
       """
    
        def connect(self):
            if self.connecting:
                #logger.info('PikaClient: Already connecting to RabbitMQ')
                return
    
            #logger.info('PikaClient: Connecting to RabbitMQ')
            self.connecting = True
    
            cred = pika.PlainCredentials('guest', 'guest')
            param = pika.ConnectionParameters(
                host='localhost',
                port=5672,
                virtual_host='/',
                credentials=cred
            )
            self.connection = TornadoConnection(param,
                on_open_callback=self.on_connected,stop_ioloop_on_close=False)
            self.connection.add_on_close_callback(self.on_closed)
    
        def on_connected(self, connection):
            logger.info('PikaClient: connected to RabbitMQ')
            self.connected = True
            self.connection = connection
            # now you are able to call the pika api to do things
            # this could be exchange setup for websocket connections to 
            # basic_publish to later.
            self.connection.channel(self.on_channel_open)
    
        def on_channel_open(self, channel):
            logger.info('PikaClient: Channel %s open, Declaring exchange' % channel)
            self.channel = channel
    
        def on_closed(self, connection):
            logger.info('PikaClient: rabbit connection closed')
            self.io_loop.stop()
    
    
    class MyWebSocketHandler(websocket.WebSocketHandler):
        def __init__(self):
            self.status = 'not connected yet'
    
        def open(self, *args, **kwargs):
            self.status = "ws open"
            self.rabbit_connect() # connect this websocket object to rabbitmq
    
        def rabbit_connect():
            self.application.pc.connection.channel(self.rabbit_channel_in_ok)
    
        def rabbit_channel_in_ok(self,channel):
            self.channel_in = channel
            self.channel_in.queue_declare(self.rabbit_declare_ok,
                                          exclusive=True,auto_delete=True)
    
    
    # and so on...
    
    
    handlers = [ your_definitions_here_like_websockets_or_such ]
    settings = { your_settings_here }
    application = tornado.web.Application(handlers,**settings)
    
    def main():
        io_loop = tornado.ioloop.IOLoop.instance()
        # PikaClient is our rabbitmq consumer
        pc = PikaClient(io_loop)
        application.pc = pc
        application.pc.connect()
        application.listen(config.tornadoport)
        try:
            io_loop.start()
        except KeyboardInterrupt:
            io_loop.stop()
    
    if __name__ == '__main__':
        main()
    

答案 1 :(得分:1)

最后,我知道了! 最新的pika组件以前的解决方案已经过时了!

1.my pika版本是1.0.1。 警告 : TornadoConnection类已更改,是根据最新的推送请求打包的。

from pika.adapters import tornado_connection

2。有一个示例:log()和config()应该忽略

import tornado.web

from handlers.notify import NotifyHandler
from function.function import config
from utils.utils import log

import pika
from pika.adapters import tornado_connection

HANDLERS = [(r'/notify', NotifyHandler)]

class PikaClient():
    def __init__(self, io_loop):
        self.io_loop = io_loop
        self.connected = False
        self.connecting = False
        self.connection = None
        self.channel = None
        self.message_count = 9


    def connect(self):
        if self.connecting:
            return
        self.connecting = True
        cred = pika.PlainCredentials('guest', 'guest')
        param = pika.ConnectionParameters(host="10.234.201.75", credentials=cred)
        self.connection = tornado_connection.TornadoConnection(param, custom_ioloop = self.io_loop, on_open_callback = self.on_connected)
        self.connection.add_on_open_error_callback(self.err)
        self.connection.add_on_close_callback(self.on_closed)


    def err(self, conn):
        log('socket error', conn)
        pass


    def on_connected(self, conn):
        log('connected')
        self.connected = True
        self.connection = conn
        self.connection.channel(channel_number = 1, on_open_callback = self.on_channel_open)


    def on_message(self, channel, method, properties, body):
        log(body)
        print('body : ', body)
        pass


    def on_channel_open(self, channel):
        self.channel = channel 
        channel.basic_consume(on_message_callback = self.on_message, queue='hello', auto_ack=True)
        return


    def on_closed(self, conn, c):
        log('pika close!')
        self.io_loop.stop()
        pass


def main():
    port = 3002
    is_debug = config('sys', 'debug')
    print('DEBUG', is_debug)
    app = tornado.web.Application(
            HANDLERS,
            debug = is_debug,
            )
    io_loop = tornado.ioloop.IOLoop.instance()
    app.pc = PikaClient(io_loop)
    app.pc.connect()
    http_server = tornado.httpserver.HTTPServer(app)
    app.listen(port)
    io_loop.start()
    print('listen {}'.format(port))


if __name__ == '__main__':
    main()