自从Cassandra 2.2.7版升级到3.0.8后,我几乎每隔几分钟就会出现一次跟踪错误。对于173.170.147.120处的节点(IP是假的,我替换了真实的节点)system.log
中的错误将是:
INFO [SharedPool-Worker-4] 2016-09-28 10:26:39,068 Message.java:605
- Unexpected exception during request; channel = [id: 0xfd64cd67,
/173.170.147.120:50660 :> /18.4.63.191:9042]
java.io.IOException: Error while read(...): Connection reset by peer
at io.netty.channel.epoll.Native.readAddress(Native Method) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.epoll.EpollSocketChannel$EpollSocketUnsafe.doReadBytes(EpollSocketChannel.java:675) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.epoll.EpollSocketChannel$EpollSocketUnsafe.epollInReady(EpollSocketChannel.java:714) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:326) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:264) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
据我所知,在所有此类错误中始终存在[id: <...>, /<broadcast_address>:<some_port> :> /<listen_address>:<native_transport_port>
。此外,broadcast_address
和listen_address
始终属于当前节点地址。
此外,无论是否有连接的客户端,都会出现问题。
出现此类错误的可能原因是什么?如何解决?
任何想法都会受到赞赏。
UPD 即可。我想,这个问题可能与旧的密钥空间迁移有关,但即使只有新创建的KS,它也会重现。