我在异步模式下执行Lua函数,并且使用NIOEventLoops。当我尝试获取下一个事件循环并执行Lua函数时,我遇到了一些异常:
com.aerospike.client.AerospikeException$Connection: Error -7 from BB967EF43270008 127.0.0.1 3000: Node BB967EF43270008 127.0.0.1 3000 event loop 5 max connections 100 would be exceeded.
at com.aerospike.client.cluster.Node.getAsyncConnection(Node.java:657) ~[aerospike-client-4.2.2.jar:?]
at com.aerospike.client.async.NioCommand.executeCommand(NioCommand.java:184) [aerospike-client-4.2.2.jar:?]
at com.aerospike.client.async.NioCommand.run(NioCommand.java:146) [aerospike-client-4.2.2.jar:?]
at com.aerospike.client.async.NioEventLoop.registerCommands(NioEventLoop.java:211) [aerospike-client-4.2.2.jar:?]
at com.aerospike.client.async.NioEventLoop.runCommands(NioEventLoop.java:173) [aerospike-client-4.2.2.jar:?]
at com.aerospike.client.async.NioEventLoop.run(NioEventLoop.java:156) [aerospike-client-4.2.2.jar:?]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
这是我获取下一个事件循环的方法:
private synchronized EventLoop getNextEventLoop() {
EventLoop next;
do {
next = eventLoops.next();
} while (next.getProcessSize() >= maxConnectionsPerEventLoop);
return next;
}
这就是我执行Lua函数的方式:
as.execute(getNextEventLoop()
, new ExecuteListener() {
@Override
public void onSuccess(Key key, Object obj) {
...
}
@Override
public void onFailure(AerospikeException exception) {
...
}
}
, writePolicy
, key
, "lua-pack"
, "funcName"
, Value.get(binName), Value.get(value)
);
如何避免这种例外情况?
答案 0 :(得分:2)
您正在达到ClientPolicy.maxConnsPerNode
的限制。对于500个maxConnsPerNode
和5个事件循环,每个事件循环可以为每个节点使用最多100(500/5)个连接。我假设您的maxConnectionsPerEventLoop
的值> =100。而且,不能保证在调用getProcessSize()
之后将下一个命令发送到事件循环时,该插槽仍然可用。
解决方案是在每个事件循环中限制maxCommandsInProcess
。这是限制飞行中的命令(从而限制连接)的线程安全方法。
EventPolicy eventPolicy = new EventPolicy();
eventPolicy.maxCommandsInProcess = 100; // max 100 commands per event loop.
eventPolicy.maxCommandsInQueue = 0; // unbounded queue
int eventLoopSize = 5;
EventLoops eventLoops = new NioEventLoops(eventPolicy, eventLoopSize);
ClientPolicy clientPolicy = new ClientPolicy();
clientPolicy.eventLoops = eventLoops;
clientPolicy.maxConnsPerNode = eventPolicy.maxCommandsInProcess * eventLoopSize;
当达到maxCommandsInProcess
限制时,异步命令队列用于命令。如果传入命令的速率始终超过处理命令的速率,则您的应用程序可能会耗尽内存。为了避免这种情况,您可能需要限制队列大小。
eventPolicy.maxCommandsInQueue = 10000;
如果达到此队列大小,则会引发AerospikeException.AsyncQueueFull
异常。您的应用程序应通过将非事件循环线程中的命令延迟直到eventLoop.getQueueSize()
足够低来进行响应。