由全局参数相应控制的Flask Socketio异步后台线程

时间:2019-10-07 11:16:12

标签: asynchronous flask flask-socketio

我正在使用作者https://github.com/miguelgrinberg/Flask-SocketIO/tree/master/example在app.py中的原始代码,并试图在FlaskSocketio中构建两个后台进程。

i)服务器已生成该代码附带的“中间”,该代码每10秒ping(有效)。

ii)我有一个与看门狗一起使用的代码,以查看目录中的文件是否被修改(log.txt)。当需要时,我需要在预标签上刷新它(例如服务器执行大量计算时的动态日志)。

我想出的策略是使用全局变量字典,从这两个线程t1,t2并将其传递到socketio线程(即background_process)(并尝试将所有操作都放入一个进程中)。

已经搜索并阅读了许多论坛,但仍无法在可用的应用程序中找到这种功能。

#import libs
#python builtins
import os
import datetime
from datetime import timedelta
#work with processes
import psutil
#work with files
import shutil
from flask import Flask, flash, request, redirect, render_template, Response, escape, jsonify, url_for, session, copy_current_request_context
#socketio
from flask_socketio import SocketIO, send, emit, join_room, leave_room, close_room, rooms, disconnect
import logging
#multithreads
import threading
from threading import Thread, Event, Lock
#implement watchfiles
import sys
import time
from time import sleep
from watchdog.observers import Observer
from watchdog.events import FileSystemEventHandler
#events
import events
#for the uploads
import urllib.request

########## Related to Thread i ################
def fn_counter():
    global dict_emit
    count = 0
    while True:
        time.sleep(10)
        count += 1
        dict_emit = {'data': 'Server generated event', 'count': count}
######################################
##########Related to thread ii##########
#Classes
class Watcher:
    def __init__(self):
        self.observer = Observer()

    def run(self, str_watchdir):
        logger.info('=> running background thread for file watchdog in '+INSTANCE_DIR)
        event_handler = Handler()
        self.observer.schedule(event_handler, str_watchdir, recursive=True)
        self.observer.start()
        try:
            while True:
                time.sleep(5)
        except:
            self.observer.stop()
            logger.info("Error")
        self.observer.join()

class Handler(FileSystemEventHandler):
    @staticmethod
    def on_any_event(event):
        global dict_emit
        global lst_clients
        #logger.info('=> on_any_event') works well
        #some available events
        #event.event_type == 'created' when file created
        #event.event_type == 'deleted' when file deleted 
        #event.event_type == 'moved' when file renamed
        #event.event_type == 'modified' when file contents changed
        if event.is_directory:
            return None
        elif event.event_type == 'modified':
            # Take any action here when a file is first created.
            logger.info('file updated')#+" "+os.path.basename(event.src_path)
            dict_emit = {'data': 'Server generated event', 'file updated': os.path.basename(event.src_path)}
####################

async_mode = None

#vars
#root
#  |-templates
#      |-index.html
#  |-static
#      |-sessions
#          |-instance1
#               |-log.txt
#          |-...
#      |-assets
#          |-log.txt

ROOT_DIR = os.getcwd()                               
TEMPLATES_DIR = os.path.join(ROOT_DIR, 'templates')  
STATIC_DIR = os.path.join(ROOT_DIR, 'static')             
SESSIONS_DIR = os.path.join(STATIC_DIR,'sessions')   
INSTANCE_DIR = os.path.join(SESSIONS_DIR, datetime.datetime.now().strftime('%d-%m-%Y_%H-%M-%S')) 
os.makedirs(INSTANCE_DIR)
shutil.copyfile(os.path.join(ASSETS_DIR, "log.txt"),
                os.path.join(INSTANCE_DIR, "log.txt"))
#Utilities
def background_thread():
    global dict_emit
    """Example of how to send server generated events to clients."""
    while True:
        time.sleep(4)
        if dict_emit:
            socketio.emit('my_response',
                          dict_emit, #{'data': 'Server generated event', 'count': count},
                          namespace='/test')
            dict_emit={}

app = Flask(__name__)
app.config.update(
    #built-in parameters
    APPLICATION_ROOT ='/', #default is '/'
    SECRET_KEY="secret_key",  #Default is None or app.config['SECRET_KEY']="secret key" 
    MAX_CONTENT_LENGTH= 160 * 1024 * 1024,  #is defaults None or app.config['MAX_CONTENT_LENGTH'] = 16 * 1024 * 1024 for 160 MB
    TEMPLATES_AUTO_RELOAD = False, #defaults None
    ENV='Production', #default 'Production'
    EXPLAIN_TEMPLATE_LOADING=True, #defaults False
    DEBUG=False, #defaults True if ENV='development'
    TESTING=False, #default False
    PROPAGATE_EXCEPTIONS=None, #default None
    PRESERVE_CONTEXT_ON_EXCEPTION=None, #defaults True if Debug True
    TRAP_HTTP_EXCEPTIONS=None, #Default False
    TRAP_BAD_REQUEST_ERRORS =None, #Defaults None
    SESSION_COOKIE_NAME='session', #Defaults session
    SESSION_COOKIE_DOMAIN=None, #defaults None
    SESSION_COOKIE_PATH=None, #defaults None
    #customized parameters
    UPLOAD_FOLDER= INSTANCE_DIR
)

#socketio
socketio = SocketIO(app, async_mode=async_mode)
thread = None
thread_lock = Lock()
lst_clients=[] #with this accessing client sid it's possible to manually emit for clients whereas otherwise only is possible from server events of app context only
#configure logger
logging.basicConfig(level=logging.INFO)
logger = logging.getLogger(__name__)

def background_thread():
    global dict_emit
    logger.info("=> Running SocketIO background_thread in 3rd background thread.")
    """Example of how to send server generated events to clients."""
    while True:
        time.sleep(4)
        if dict_emit:
            socketio.emit('my_response',
                          dict_emit, #{'data': 'Server generated event', 'count': count},
                          namespace='/test')
            dict_emit={}

@app.route('/')
def index():
    return render_template('index.html', async_mode=socketio.async_mode)

@socketio.on('connect', namespace='/test')
def test_connect():
    global thread
    global lst_clients
    logger.info(' Client connected ' + request.sid)
    lst_clients.append(request.sid)
    with thread_lock:
        if thread is None:
            thread = socketio.start_background_task(background_thread)
    emit('my_response', {'data': 'Connected', 'count': 0})

if __name__ == '__main__':
    global t1
    global t2
    #threads share same namespace on variables
    #launch filewatchdog
    w1=Watcher()
    # creating threads 
    t1 = threading.Thread(target=w1.run, args=(INSTANCE_DIR,)) 
    # starting thread 1 
    t1.start() 
    logger.info("=> Running watchdog for " + INSTANCE_DIR + " in 1st background thread.")

    #launch counter
    t2 = threading.Thread(target=fn_counter)
    t2.start()
    logger.info("=> Running counter in 2nd background thread.")

    logger.info('=> Running socket IO in main thread.')
    socketio.run(app, 
                host='localhost',
                 port=10000, 
                 debug=False) #True sends some exceptions and stops)
<!DOCTYPE HTML>
<html>
    <head>
<script src="//code.jquery.com/jquery-1.12.4.min.js" integrity="sha256-ZosEbRLbNQzLpnKIkEdrPv7lOy9C27hHQ+Xp8a4MxAQ=" crossorigin="anonymous"></script>
<script src="//cdnjs.cloudflare.com/ajax/libs/socket.io/2.2.0/socket.io.js" integrity="sha256-yr4fRk/GU1ehYJPAs8P4JlTgu0Hdsp4ZKrx8bDEDC3I=" crossorigin="anonymous"></script>
<script type="text/javascript" charset="utf-8">
    $(document).ready(function() {
        // Use a "/test" namespace.
        // An application can open a connection on multiple namespaces, and
        // Socket.IO will multiplex all those connections on a single
        // physical channel. If you don't care about multiple channels, you
        // can set the namespace to an empty string.
        namespace = '/test';

        // Connect to the Socket.IO server.
        // The connection URL has the following format, relative to the current page:
        //     http[s]://<domain>:<port>[/<namespace>]
        var socket = io(namespace);

        // Event handler for new connections.
        // The callback function is invoked when a connection with the
        // server is established.
        socket.on('connect', function() {
            socket.emit('my_event', {data: 'I\'m connected!'});
        });

// Event handler for server sent data.
        // The callback function is invoked whenever the server emits data
        // to the client. The data is then displayed in the "Received"
        // section of the page.
        socket.on('my_response', function(msg, cb) {
            $('#log').append('<br>' + $('<div/>').text('Received #' + msg.count + ': ' + msg.data).html());
            if (cb)
                cb();
        });
    });
</script>
</head>
</html>

还没有添加更改INSTANCE_DIR log.txt内容的功能,尽管在服务器运行时手动进行操作很容易,只需转到该文件夹​​即可手动打开log.txt进行更改然后保存。

它将触发文件更新事件。

经过测试的其他想法:

->将t1和t2移到background_thread()中,这会大大增加延迟时间

->尽管服务器显示站点,但将t1和t2移至def test_connect()不会刷新。

欢呼

0 个答案:

没有答案