将控制权归还运输工具

时间:2018-11-20 02:47:43

标签: python twisted twisted.internet

我正在尝试模拟服务器定期接收数据的情况。在我的设置中,我运行一个进程来设置服务器,而另一个进程则设置一堆客户端(足以想到一个客户端)。我通过将大部分here中的点点滴滴拼凑起来,从而建立了一些代码。服务器/客户端通过使用transport.write发送消息进行通信。首先,服务器告诉客户端启动(这可以正常使用AFAIK)。客户端在取得进展时会向服务器报告。我感到困惑的是,客户端完成后,我只会在最后获得这些间歇性消息。这可能是缓冲区刷新的问题,我尝试了(未成功)诸如This之类的事情。另外,每条消息都很大,我尝试多次发送同一条消息,以便清除缓冲区。

我怀疑returning the control to the transport出现了问题,但是我不知道该如何解决。

非常感谢您提供的有关此问题或任何其他问题的帮助。

服务器:

from twisted.internet import reactor, protocol

import time
import serverSideAnalysis
import pdb
#import bson, json, msgpack
import _pickle as pickle  # I expect the users to authenticate and not 
                          # do anything malicious. 


PORT = 9000
NUM = 1
local_scratch="/local/scratch"


class Hub(protocol.Protocol):
  def __init__(self,factory, clients, nclients):
    self.clients = clients 
    self.nclients = nclients
    self.factory = factory
    self.dispatcher = serverSideAnalysis.ServerTalker(NUM, self, 
          local_scratch)

  def connectionMade(self):
    print("connected to user" , (self))
    if len(self.clients) < self.nclients:
      self.factory.clients.append(self)
    else:
      self.factory.clients[self.nclients] = self
    if len(self.clients) == NUM:
      val = input("Looks like everyone is here, shall we start? (Y/N)")
      while (val.upper() != "Y"):
        time.sleep(20)
        val = input("Looks like everyone is here, shall we start??? (Y/N)")
      message = pickle.dumps({"TASK": "INIT", "SUBTASK":"STORE"})
      self.message(message) # This reaches the client as I had expected

  def message(self, command):
    for c in self.factory.clients:
      c.transport.write(command)

  def connectionLost(self, reason):
    self.factory.clients.remove(self)
    self.nclients -= 1

  def dataReceived(self, data):
    if len(self.clients) == NUM:
      self.dispatcher.dispatch(data)

class PauseTransport(protocol.Protocol):
  def makeConnection(self, transport):
    transport.pauseProducing()

class HubFactory(protocol.Factory):
  def __init__(self, num):
    self.clients = set([])
    self.nclients = 0 
    self.totConnections = num

  def buildProtocol(self, addr):
    print(self.nclients)
    if self.nclients < self.totConnections:
      self.nclients += 1
      return Hub(self, self.clients, self.nclients)
    protocol = PauseTransport()
    protocol.factory = self
    return protocol

factory = HubFactory(NUM)
reactor.listenTCP(PORT, factory)
factory.clients = []
reactor.run()

客户:

from twisted.internet import reactor, protocol
import time
import clientSideAnalysis
import sys


HOST = 'localhost'
PORT = 9000
local_scratch="/local/scratch"

class MyClient(protocol.Protocol):

  def connectionMade(self):
    print("connected!")
    self.factory.clients.append(self)
    print ("clients are ", self.factory.clients)

    self.cdispatcher = clientSideAnalysis.ServerTalker(analysis_file_name, local_scratch, self)

  def clientConnectionLost(self, reason):
    #TODO send warning
    self.factory.clients.remove(self)

  def dataReceived(self, data): #This is the problematic part I think
    self.cdispatcher.dispatch(data)
    print("1 sent")
    time.sleep(10)
    self.cdispatcher.dispatch(data)
    print("2 sent")
    time.sleep(10)
    self.cdispatcher.dispatch(data)
    time.sleep(10)


  def message(self, data):
    self.transport.write(data)

class MyClientFactory(protocol.ClientFactory):
  protocol = MyClient

if __name__=="__main__":
  analysis_file_name = sys.argv[1]

  factory = MyClientFactory()
  reactor.connectTCP(HOST, PORT, factory)
  factory.clients = []
  reactor.run()

有关调度员的工作的最后相关信息。

在两种情况下,它们都加载已到达的消息(字典)并根据内容进行一些计算。他们不时使用message方法与当前值进行通信。

最后,我正在使用python 3.6。并扭成18.9.0

1 个答案:

答案 0 :(得分:0)

从Protocol.dataReceived方法中将控制权返回给反应堆的方式是从该方法中返回。例如:

def dataReceived(self, data):
    self.cdispatcher.dispatch(data)
    print("1 sent")

如果您想在此之后 进行更多工作,则可以选择一些方法。如果您希望工作在一段时间后发生,请使用reactor.callLater。如果您希望工作在分派到另一个线程后进行,请使用twisted.internet.threads.deferToThread。如果您希望工作响应某个其他事件(例如,正在接收数据)而发生,请将其放入处理该事件的回调中(例如,dataReceived)。