在Apache PLC4X项目(https://plc4x.apache.org)中,我们正在使用Netty实现工业PLC的驱动程序。这里通常有各种协议分层。有时,一层要求我们将一条消息拆分为底层的多条消息。现在我们面临一个大问题:一个协议协商每个连接的最大数量的未确认消息。因此,我们无法发送超过此最大值的消息,或者接收器只会发送错误响应。
现在我们不需要在encode方法中添加“out”,但是要将它们添加到某种队列并且有一些Netty机制负责排空那个队列......在Netty中是否存在这样的机制?如果没有,那么实现这个的最佳方式是什么?
如果具有良好Netty洞察力的人可以加入我们的项目邮件列表(dev@plc4x.apache.org),那也很酷,因为我们还在为Netty做一些非常酷的补充(以太网帧上的原始套接字传输和一个在IP数据包基础上)...我敢打赌这两个项目可以互相帮助。
答案 0 :(得分:2)
虽然Netty没有提供开箱即用的这样的处理程序,但由于内部设计,很容易使这种最大并发待处理请求开箱即用。
可以使用Netty框架中的PendingWriteQueue
类和通用处理程序来完成这样的处理程序:
import io.netty.channel.ChannelHandlerAdapter;
import io.netty.channel.ChannelHandlerContext;
import io.netty.channel.ChannelPromise;
import io.netty.channel.PendingWriteQueue;
public class MaxPendingRequestHandler extends ChannelHandlerAdapter {
private PendingWriteQueue queue;
private int freeSlots;
public MaxPendingRequestHandler(int maxRequests) {
this.freeSlots = maxRequests;
}
private synchronized void trySendMessages(ChannelHandlerContext ctx) {
if(this.freeSlots > 0) {
while(this.freeSlots > 0) {
if(this.queue.removeAndWrite() == null) {
ctx.flush();
return;
}
this.freeSlots--;
}
ctx.flush();
}
}
@Override
public void channelRegistered(ChannelHandlerContext ctx) throws Exception {
this.queue = new PendingWriteQueue(ctx);
}
@Override
public void channelInactive(ChannelHandlerContext ctx) throws Exception {
// Send everything so we get a proper failurefor those pending writes
this.queue.removeAndWriteAll();
super.channelInactive(ctx);
}
@Override
public void channelUnregistered(ChannelHandlerContext ctx) throws Exception {
this.queue.removeAndWriteAll();
super.channelUnregistered(ctx);
}
@Override
public void write(ChannelHandlerContext ctx, Object msg, ChannelPromise promise) throws Exception {
this.queue.add(msg, promise);
trySendMessages(ctx);
}
@Override
public void channelRead(ChannelHandlerContext ctx, Object msg) throws Exception {
synchronized(this) {
this.freeSlots++;
trySendMessages(ctx);
}
super.channelRead(ctx, msg);
}
}
此处理程序的工作原理是它将每个新消息保存在队列中,并在每次写入/读取时检查线路上的空闲插槽。
请注意,处理程序应放在数据包解码器/编码器之后的管道中,否则将传入数据包计为潜在的多个数据包时会发生问题,例如:
pipeline.addLast(new PacketCodex()); // A codex exists of an encoder and decoder, you can also ass them seperately
// pipeline.addLast(new TrafficShapingHandler()) // Optional, depending on your required protocols
// pipeline.addLast(new IdleStateHandler()) // Optional, depending on your required protocols
pipeline.addLast(new MaxPendingRequestHandler())
pipeline.addLast(new Businesshandler())
当然,您还需要验证我们的处理程序是否有效,这可以使用包含EmbeddedChannel
&的单元测试来完成。 JUnit的:
public class MaxPendingRequestHandlerTest {
@Test
public void testMaxPending() {
EmbeddedChannel channel = new EmbeddedChannel(new MaxPendingRequestHandler(3));
// channel.writeOutbound("1", "2", "3"); // This doesn't work as it expects operations to complete directly
channel.write("1");
channel.write("2");
channel.write("3");
channel.write("4");
channel.write("5");
channel.write("6");
Assert.assertEquals(channel.readOutbound(), "1");
Assert.assertEquals(channel.readOutbound(), "2");
Assert.assertEquals(channel.readOutbound(), "3");
Assert.assertEquals(channel.readOutbound(), (Object)null);
}
@Test
public void testMaxPendingWhenAResponseHasReceived() {
EmbeddedChannel channel = new EmbeddedChannel(new MaxPendingRequestHandler(3));
// channel.writeOutbound("1", "2", "3"); // This doesn't work as it expects operations to complete directly
channel.write("1");
channel.write("2");
channel.write("3");
channel.write("4");
channel.write("5");
channel.write("6");
channel.writeInbound("RE: 1");
Assert.assertEquals(channel.readOutbound(), "1");
Assert.assertEquals(channel.readOutbound(), "2");
Assert.assertEquals(channel.readOutbound(), "3");
Assert.assertEquals(channel.readOutbound(), "4");
Assert.assertEquals(channel.readOutbound(), (Object)null);
}
@Test
public void testMaxPendingWhenAllResponseHasReceived() {
EmbeddedChannel channel = new EmbeddedChannel(new MaxPendingRequestHandler(3));
// channel.writeOutbound("1", "2", "3"); // This doesn't work as it expects operations to complete directly
channel.write("1");
channel.write("2");
channel.write("3");
channel.write("4");
channel.write("5");
channel.write("6");
channel.writeInbound("RE: 1");
channel.writeInbound("RE: 2");
channel.writeInbound("RE: 3");
channel.writeInbound("RE: 4");
channel.writeInbound("RE: 5");
channel.writeInbound("RE: 6");
Assert.assertEquals(channel.readOutbound(), "1");
Assert.assertEquals(channel.readOutbound(), "2");
Assert.assertEquals(channel.readOutbound(), "3");
Assert.assertEquals(channel.readOutbound(), "4");
Assert.assertEquals(channel.readOutbound(), "5");
Assert.assertEquals(channel.readOutbound(), "6");
Assert.assertEquals(channel.readOutbound(), (Object)null);
}
@Test
public void testMaxPendingWhenAllResponseHasReceivedAndNewMessagesAreSend() {
EmbeddedChannel channel = new EmbeddedChannel(new MaxPendingRequestHandler(3));
// channel.writeOutbound("1", "2", "3"); // This doesn't work as it expects operations to complete directly
channel.write("1");
channel.write("2");
channel.write("3");
channel.write("4");
channel.write("5");
channel.write("6");
channel.writeInbound("RE: 1");
channel.writeInbound("RE: 2");
channel.writeInbound("RE: 3");
channel.writeInbound("RE: 4");
channel.writeInbound("RE: 5");
channel.writeInbound("RE: 6");
channel.write("7");
channel.write("8");
channel.write("9");
channel.write("10");
Assert.assertEquals(channel.readOutbound(), "1");
Assert.assertEquals(channel.readOutbound(), "2");
Assert.assertEquals(channel.readOutbound(), "3");
Assert.assertEquals(channel.readOutbound(), "4");
Assert.assertEquals(channel.readOutbound(), "5");
Assert.assertEquals(channel.readOutbound(), "6");
Assert.assertEquals(channel.readOutbound(), "7");
Assert.assertEquals(channel.readOutbound(), "8");
Assert.assertEquals(channel.readOutbound(), "9");
Assert.assertEquals(channel.readOutbound(), (Object)null);
}
}