我们的cassandra节点在没有任何请求的情况下达到近90%的负载。在日志中我们可以看到此异常。有人至少有想法吗?
我们的软件在其他环境中运行时没有问题。
INFO [CompactionExecutor:36366] 2017-02-02 12:27:06,708 NoSpamLogger.java:91 - 达到的最大内存使用量(512.000MiB), 不能分配1.000MiB的块
DEBUG [SharedPool-Worker-31] 2017-02-02 15:15:43,015 ReadCallback.java:126 - 失败;收到0回复1的回复WARN [SharedPool-Worker-34] 2017-02-02 15:15:43,015 AbstractLocalAwareExecutorService.java:169 - 未捕获的异常 thread Thread [SharedPool-Worker-34,5,main]:{} org.xerial.snappy.SnappyError:[NOT_A_DIRECT_BUFFER]目的地是 不是直接的缓冲区 org.xerial.snappy.Snappy.uncompress(Snappy.java:509) 〜[snappy-java-1.1.1.7.jar:na] at org.apache.cassandra.io.compress.SnappyCompressor.uncompress(SnappyCompressor.java:102) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.util.CompressedSegmentedFile $ Mmap.readChunk(CompressedSegmentedFile.java:323) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.cache.ChunkCache.load(ChunkCache.java:137) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.cache.ChunkCache.load(ChunkCache.java:19) 〜[apache-cassandra-3.7.jar:3.7] at com.github.benmanes.caffeine.cache.BoundedLocalCache $ BoundedLocalLoadingCache.lambda美元的新$ 0(BoundedLocalCache.java:2949) 〜[caffeine-2.2.6.jar:na] at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda $ doComputeIfAbsent $ 15(BoundedLocalCache.java:1807) 〜[caffeine-2.2.6.jar:na] at java.util.concurrent.ConcurrentHashMap.compute(未知来源) 〜[na:1.8.0_112] at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:1805) 〜[caffeine-2.2.6.jar:na] at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:1788) 〜[caffeine-2.2.6.jar:na] at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:97) 〜[caffeine-2.2.6.jar:na] at com.github.benmanes.caffeine.cache.LocalLoadingCache.get(LocalLoadingCache.java:66) 〜[caffeine-2.2.6.jar:na] at org.apache.cassandra.cache.ChunkCache $ CachingRebufferer.rebuffer(ChunkCache.java:215) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.cache.ChunkCache $ CachingRebufferer.rebuffer(ChunkCache.java:193) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.util.RandomAccessReader.reBufferAt(RandomAccessReader.java:78) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.util.RandomAccessReader.seek(RandomAccessReader.java:220) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.sstable.format.big.BigTableScanner.seekToCurrentRangeStart(BigTableScanner.java:186) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.sstable.format.big.BigTableScanner.access $ 200(BigTableScanner.java:51) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.sstable.format.big.BigTableScanner $ KeyScanningIterator.computeNext(BigTableScanner.java:285) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.sstable.format.big.BigTableScanner $ KeyScanningIterator.computeNext(BigTableScanner.java:265) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.io.sstable.format.big.BigTableScanner.hasNext(BigTableScanner.java:245) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.utils.MergeIterator $ Candidate.advance(MergeIterator.java:374) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.utils.MergeIterator $ ManyToOne.advance(MergeIterator.java:186) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.utils.MergeIterator $ ManyToOne.computeNext(MergeIterator.java:155) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.partitions.UnfilteredPartitionIterators $ 4.hasNext(UnfilteredPartitionIterators.java:216) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:72) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.partitions.UnfilteredPartitionIterators $ Serializer.serialize(UnfilteredPartitionIterators.java:289) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.ReadResponse $ LocalDataResponse.build(ReadResponse.java:134) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.ReadResponse $ LocalDataResponse。(ReadResponse.java:127) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.ReadResponse $ LocalDataResponse。(ReadResponse.java:123) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.ReadResponse.createDataResponse(ReadResponse.java:65) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.db.ReadCommand.createResponse(ReadCommand.java:292) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.service.StorageProxy $ LocalReadRunnable.runMayThrow(StorageProxy.java:1799) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.service.StorageProxy $ DroppableRunnable.run(StorageProxy.java:2466) 〜[apache-cassandra-3.7.jar:3.7] at java.util.concurrent.Executors $ RunnableAdapter.call(Unknown Source) 〜[na:1.8.0_112] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService $ FutureTask.run(AbstractLocalAwareExecutorService.java:164) 〜[apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService $ LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:136) [apache-cassandra-3.7.jar:3.7] at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [apache-cassandra-3.7.jar:3.7]在java.lang.Thread.run(未知 来源)[na:1.8.0_112] DEBUG [SharedPool-Worker-30] 2017-02-02 15:15:43,419 ReadCallback.java:126 - 超时;收到1回复中的1个 (包括数据)DEBUG [SharedPool-Worker-30] 2017-02-02 15:15:52,744 ReadCallback.java:126 - 超时;收到1回复中的1个 (包括数据)DEBUG [GossipStage:1] 2017-02-02 15:15:58,789 FailureDetector.java:456 - 忽略2154429836的间隔时间 /172.26.216.8 DEBUG [GossipStage:1] 2017-02-02 15:15:58,789 FailureDetector.java:456 - 忽略2000371819的间隔时间 /172.26.216.4 DEBUG [GossipStage:1] 2017-02-02 15:16:00,999 FailureDetector.java:456 - 忽略2209666046的间隔时间 /172.26.216.8 DEBUG [GossipStage:1] 2017-02-02 15:16:00,999 FailureDetector.java:456 - 忽略2209670711的间隔时间 /172.26.216.4