我们的kafka在k8s吊舱中运行。在我们的产品环境中，kafka发生故障，然后重新启动。在kafka日志恢复期间，它再次崩溃。
在hs_err_pid.log中，我发现内存：Memory: 4k page, physical 8388608k(2892k free)，但是堆内存还剩很多：Heap: garbage-first heap total 524288K, used 330445K。
kafka版本：kafka_2.11-1.1.1
这是我的Kafka配置：
advertised.host.name = rgibns1
advertised.listeners = PLAINTEXT://172.18.130.22:9092
advertised.port = 9092
alter.config.policy.class.name = null
alter.log.dirs.replication.quota.window.num = 11
alter.log.dirs.replication.quota.window.size.seconds = 1
authorizer.class.name =
auto.create.topics.enable = false
auto.leader.rebalance.enable = true
background.threads = 10
broker.id = 1
broker.id.generation.enable = true
broker.rack = null
compression.type = producer
connections.max.idle.ms = 600000
controlled.shutdown.enable = true
controlled.shutdown.max.retries = 3
controlled.shutdown.retry.backoff.ms = 5000
controller.socket.timeout.ms = 30000
create.topic.policy.class.name = null
default.replication.factor = 1
delegation.token.expiry.check.interval.ms = 3600000
delegation.token.expiry.time.ms = 86400000
delegation.token.master.key = null
delegation.token.max.lifetime.ms = 604800000
delete.records.purgatory.purge.interval.requests = 1
delete.topic.enable = true
fetch.purgatory.purge.interval.requests = 1000
group.initial.rebalance.delay.ms = 0
group.max.session.timeout.ms = 300000
group.min.session.timeout.ms = 6000
host.name =
inter.broker.listener.name = null
inter.broker.protocol.version = 1.1-IV0
leader.imbalance.check.interval.seconds = 300
leader.imbalance.per.broker.percentage = 10
listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL
listeners = PLAINTEXT://172.18.130.22:9092
log.cleaner.backoff.ms = 15000
log.cleaner.dedupe.buffer.size = 134217728
log.cleaner.delete.retention.ms = 86400000
log.cleaner.enable = true
log.cleaner.io.buffer.load.factor = 0.9
log.cleaner.io.buffer.size = 524288
log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
log.cleaner.min.cleanable.ratio = 0.5
log.cleaner.min.compaction.lag.ms = 0
log.cleaner.threads = 1
log.cleanup.policy = [delete]
log.dir = /tmp/kafka-logs
log.dirs = /kafka/kafka-logs-rgibns1
log.flush.interval.messages = 9223372036854775807
log.flush.interval.ms = null
log.flush.offset.checkpoint.interval.ms = 60000
log.flush.scheduler.interval.ms = 9223372036854775807
log.flush.start.offset.checkpoint.interval.ms = 60000
log.index.interval.bytes = 4096
log.index.size.max.bytes = 10485760
log.message.format.version = 1.1-IV0
log.message.timestamp.difference.max.ms = 9223372036854775807
log.message.timestamp.type = CreateTime
log.preallocate = false
log.retention.bytes = 2147483648
log.retention.check.interval.ms = 300000
log.retention.hours = 24
log.retention.minutes = null
log.retention.ms = null
log.roll.hours = 168
log.roll.jitter.hours = 0
log.roll.jitter.ms = null
log.roll.ms = null
log.segment.bytes = 1073741824
log.segment.delete.delay.ms = 60000
max.connections.per.ip = 2147483647
max.connections.per.ip.overrides =
max.incremental.fetch.session.cache.slots = 1000
message.max.bytes = 2097152
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
min.insync.replicas = 1
num.io.threads = 8
num.network.threads = 3
num.partitions = 3
num.recovery.threads.per.data.dir = 3
num.replica.alter.log.dirs.threads = null
num.replica.fetchers = 1
offset.metadata.max.bytes = 4096
offsets.commit.required.acks = -1
offsets.commit.timeout.ms = 5000
offsets.load.buffer.size = 5242880
offsets.retention.check.interval.ms = 600000
offsets.retention.minutes = 1440
offsets.topic.compression.codec = 0
offsets.topic.num.partitions = 50
offsets.topic.replication.factor = 1
offsets.topic.segment.bytes = 104857600
password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding
password.encoder.iterations = 4096
password.encoder.key.length = 128
password.encoder.keyfactory.algorithm = null
password.encoder.old.secret = null
password.encoder.secret = null
port = 9092
principal.builder.class = null
producer.purgatory.purge.interval.requests = 1000
queued.max.request.bytes = -1
queued.max.requests = 500
quota.consumer.default = 9223372036854775807
quota.producer.default = 9223372036854775807
quota.window.num = 11
quota.window.size.seconds = 1
replica.fetch.backoff.ms = 1000
replica.fetch.max.bytes = 2197152
replica.fetch.min.bytes = 1
replica.fetch.response.max.bytes = 10485760
replica.fetch.wait.max.ms = 500
replica.high.watermark.checkpoint.interval.ms = 5000
replica.lag.time.max.ms = 10000
replica.socket.receive.buffer.bytes = 65536
replica.socket.timeout.ms = 30000
replication.quota.window.num = 11
replication.quota.window.size.seconds = 1
request.timeout.ms = 30000
reserved.broker.max.id = 1000
sasl.enabled.mechanisms = [GSSAPI]
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.principal.to.local.rules = [DEFAULT]
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism.inter.broker.protocol = GSSAPI
security.inter.broker.protocol = PLAINTEXT
socket.receive.buffer.bytes = 102400
socket.request.max.bytes = 104857600
socket.send.buffer.bytes = 102400
ssl.cipher.suites = []
ssl.client.auth = none
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.abort.timed.out.transaction.cleanup.interval.ms = 60000
transaction.max.timeout.ms = 900000
transaction.remove.expired.transaction.cleanup.interval.ms = 3600000
transaction.state.log.load.buffer.size = 5242880
transaction.state.log.min.isr = 1
transaction.state.log.num.partitions = 50
transaction.state.log.replication.factor = 1
transaction.state.log.segment.bytes = 104857600
transactional.id.expiration.ms = 604800000
unclean.leader.election.enable = false
zookeeper.connect = rgibns1:2181
zookeeper.connection.timeout.ms = 6000
zookeeper.max.in.flight.requests = 10
zookeeper.session.timeout.ms = 70000
zookeeper.set.acl = false
zookeeper.sync.time.ms = 2000
hs_err_pid.log：
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f9880733ad0, pid=1, tid=0x00007f9854ac5700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_191-b12) (build 1.8.0_191-b12)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.191-b12 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# J 1205 sun.nio.ch.NativeThread.current()J (0 bytes) @ 0x00007f9880733ad0 [0x00007f9880733a00+0xd0]
#
# Core dump written. Default location: /user/rgwok/core or core.1
#
# Can not save log file, dump to screen..
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f9880733ad0, pid=1, tid=0x00007f9854ac5700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_191-b12) (build 1.8.0_191-b12)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.191-b12 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# J 1205 sun.nio.ch.NativeThread.current()J (0 bytes) @ 0x00007f9880733ad0 [0x00007f9880733a00+0xd0]
#
# Core dump written. Default location: /user/rgwok/core or core.1
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
--------------- T H R E A D ---------------
Current thread (0x00007f9890c1e000): JavaThread "pool-4-thread-2" [_thread_in_native_trans, id=537, stack(0x00007f98549c5000,0x00007f9854ac6000)]
siginfo: si_signo: 11 (SIGSEGV), si_code: 0 (SI_USER)
Registers:
RAX=0x00007f9854ac5700, RBX=0x00007f9870008c70, RCX=0x0000000000000e00, RDX=0x00000000806983d0
RSP=0x00007f9854ac3e30, RBP=0x00007f9854ac3e70, RSI=0x00007f9854ac3e60, RDI=0x00007f9890c1e1f8
R8 =0x000000002000529e, R9 =0x00000000803ebd10, R10=0x00007f98963a8000, R11=0x000000008cd1d1a8
R12=0x0000000000000000, R13=0x0000000007983320, R14=0x00007f9854ac3e60, R15=0x00007f9890c1e000
RIP=0x00007f9880733ad0, EFLAGS=0x0000000000010206, CSGSFS=0x0000000000000033, ERR=0x0000000000000007
TRAPNO=0x000000000000000e
Top of Stack: (sp=0x00007f9854ac3e30)
0x00007f9854ac3e30: 000000008cd0e560 00007f9894ddec37
0x00007f9854ac3e40: 0000000080300000 00000001000007a8
0x00007f9854ac3e50: 0000000000002848 00007f98808cbae7
0x00007f9854ac3e60: 00000000805996f8 2001122b2000529e
0x00007f9854ac3e70: 000000002000529e 00007f98808cb4a0
0x00007f9854ac3e80: 000000008cd1d1a8 0000000000002848
0x00007f9854ac3e90: 000000008cd0e580 000000008cd20830
0x00007f9854ac3ea0: 000000008cd1d1a8 00007f988094e620
0x00007f9854ac3eb0: 0000000007983320 000000008cd209a0
0x00007f9854ac3ec0: 000000008ce579b8 0000000b8cd13c30
0x00007f9854ac3ed0: 0000000000000079 00007f987e5ab000
0x00007f9854ac3ee0: 000000008cd0e620 00007f988091d4ec
0x00007f9854ac3ef0: 0000000000000079 000000008cd0e620
0x00007f9854ac3f00: 000000008cd20830 00007f988091341c
0x00007f9854ac3f10: 000000008cd207f8 000000008cd13c20
0x00007f9854ac3f20: 000000008cd20810 000000118cd20830
0x00007f9854ac3f30: 000000008cd0e580 0000000007983320
0x00007f9854ac3f40: 000000009598b648 000000009598b220
0x00007f9854ac3f50: 00007f9854ac4360 00007f9880a18104
0x00007f9854ac3f60: 000000008cd0e640 00007f98808ca4a8
0x00007f9854ac3f70: 000000008cd0e620 00007f98806c36bc
0x00007f9854ac3f80: 000000008cd0e640 00007f98807d1b5c
0x00007f9854ac3f90: 00000000805b9380 000000009598b648
0x00007f9854ac3fa0: 00007f9854ac4360 00007f98808cabc4
0x00007f9854ac3fb0: 0000000095985db8 0000000000000002
0x00007f9854ac3fc0: 00007f9854ac4360 00007f9880b4a089
0x00007f9854ac3fd0: 000000009598b660 00007f988090c378
0x00007f9854ac3fe0: 00000001000f1b98 000000009598b648
0x00007f9854ac3ff0: 0000000000000000 000000009598b660
0x00007f9854ac4000: 00000001000f1b98 00007f9880ade0be
0x00007f9854ac4010: 00007f9854ac4360 00007f9880ade2c4
0x00007f9854ac4020: 000000009598b620 000000009598adb0
Instructions: (pc=0x00007f9880733ad0)
0x00007f9880733ab0: c7 87 70 02 00 00 05 00 00 00 41 8b cf c1 e9 04
0x00007f9880733ac0: 81 e1 fc 0f 00 00 49 ba 00 80 3a 96 98 7f 00 00
0x00007f9880733ad0: 41 89 0c 0a 81 3d 26 24 03 15 00 00 00 00 0f 85
0x00007f9880733ae0: 0e 00 00 00 41 81 7f 30 00 00 00 00 0f 84 21 00
Register to memory mapping:
RAX=0x00007f9854ac5700 is pointing into the stack for thread: 0x00007f9890c1e000
RBX=0x00007f9870008c70 is an unknown value
RCX=0x0000000000000e00 is an unknown value
RDX=0x00000000806983d0 is an oop
java.lang.Object
- klass: 'java/lang/Object'
RSP=0x00007f9854ac3e30 is pointing into the stack for thread: 0x00007f9890c1e000
RBP=0x00007f9854ac3e70 is pointing into the stack for thread: 0x00007f9890c1e000
RSI=0x00007f9854ac3e60 is pointing into the stack for thread: 0x00007f9890c1e000
RDI=0x00007f9890c1e1f8 is an unknown value
R8 =0x000000002000529e is an unknown value
R9 =0x00000000803ebd10 is an oop
java.lang.Thread
- klass: 'java/lang/Thread'
R10=0x00007f98963a8000 is an unknown value
R11=0x000000008cd1d1a8 is an oop
sun.nio.ch.NativeThreadSet
- klass: 'sun/nio/ch/NativeThreadSet'
R12=0x0000000000000000 is an unknown value
R13=0x0000000007983320 is an unknown value
R14=0x00007f9854ac3e60 is pointing into the stack for thread: 0x00007f9890c1e000
R15=0x00007f9890c1e000 is a thread
Stack: [0x00007f98549c5000,0x00007f9854ac6000], sp=0x00007f9854ac3e30, free space=1019k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
J 1205 sun.nio.ch.NativeThread.current()J (0 bytes) @ 0x00007f9880733ad0 [0x00007f9880733a00+0xd0]
J 1928 C2 sun.nio.ch.FileChannelImpl.read(Ljava/nio/ByteBuffer;J)I (90 bytes) @ 0x00007f98808cb4a0 [0x00007f98808cb280+0x220]
J 2020 C2 org.apache.kafka.common.utils.AbstractIterator.hasNext()Z (58 bytes) @ 0x00007f988091341c [0x00007f9880913280+0x19c]
J 1970 C2 scala.collection.Iterator$class.foreach(Lscala/collection/Iterator;Lscala/Function1;)V (26 bytes) @ 0x00007f98808ca4a8 [0x00007f98808ca400+0xa8]
J 1969 C1 scala.collection.AbstractIterable.foreach(Lscala/Function1;)V (6 bytes) @ 0x00007f98808cabc4 [0x00007f98808ca960+0x264]
J 3059 C1 kafka.log.LogSegment.recover(Lkafka/log/ProducerStateManager;Lscala/Option;)I (175 bytes) @ 0x00007f9880ade2c4 [0x00007f9880adb840+0x2a84]
J 3143 C1 kafka.log.Log.kafka$log$Log$$recoverSegment(Lkafka/log/LogSegment;Lscala/Option;)I (124 bytes) @ 0x00007f98809750cc [0x00007f98809747e0+0x8ec]
j kafka.log.Log.recoverLog()J+132
J 3373 C1 kafka.log.Log.loadSegments()J (128 bytes) @ 0x00007f9880b99b84 [0x00007f9880b98400+0x1784]
j kafka.log.Log.<init>(Ljava/io/File;Lkafka/log/LogConfig;JJLkafka/utils/Scheduler;Lkafka/server/BrokerTopicStats;Lorg/apache/kafka/common/utils/Time;IILorg/apache/kafka/common/TopicPartition;Lkafka/log/ProducerStateManager;Lkafka/server/LogDirFailureChannel;)V+231
j kafka.log.Log$.apply(Ljava/io/File;Lkafka/log/LogConfig;JJLkafka/utils/Scheduler;Lkafka/server/BrokerTopicStats;Lorg/apache/kafka/common/utils/Time;IILkafka/server/LogDirFailureChannel;)Lkafka/log/Log;+46
j kafka.log.LogManager.kafka$log$LogManager$$loadLog(Ljava/io/File;Lscala/collection/Map;Lscala/collection/Map;)V+167
j kafka.log.LogManager$$anonfun$loadLogs$2$$anonfun$11$$anonfun$apply$15$$anonfun$apply$2.apply$mcV$sp()V+49
J 3372 C1 kafka.utils.CoreUtils$$anon$1.run()V (10 bytes) @ 0x00007f9880b83584 [0x00007f9880b83480+0x104]
J 3502 C1 java.util.concurrent.FutureTask.run()V (126 bytes) @ 0x00007f9880be1f7c [0x00007f9880be1ca0+0x2dc]
j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [libjvm.so+0x6852db] JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0xddb
V [libjvm.so+0x682ba3] JavaCalls::call_virtual(JavaValue*, KlassHandle, Symbol*, Symbol*, JavaCallArguments*, Thread*)+0x263
V [libjvm.so+0x683167] JavaCalls::call_virtual(JavaValue*, Handle, KlassHandle, Symbol*, Symbol*, Thread*)+0x47
V [libjvm.so+0x6ef0ec] thread_entry(JavaThread*, Thread*)+0x6c
V [libjvm.so+0xa76f9b] JavaThread::thread_main_inner()+0xdb
V [libjvm.so+0xa7722f] JavaThread::run()+0x25f
V [libjvm.so+0x909c92] java_start(Thread*)+0x102
C [libpthread.so.0+0x76ba] start_thread+0xca
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J 1205 sun.nio.ch.NativeThread.current()J (0 bytes) @ 0x00007f9880733a3e [0x00007f9880733a00+0x3e]
J 1928 C2 sun.nio.ch.FileChannelImpl.read(Ljava/nio/ByteBuffer;J)I (90 bytes) @ 0x00007f98808cb4a0 [0x00007f98808cb280+0x220]
J 2020 C2 org.apache.kafka.common.utils.AbstractIterator.hasNext()Z (58 bytes) @ 0x00007f988091341c [0x00007f9880913280+0x19c]
J 1970 C2 scala.collection.Iterator$class.foreach(Lscala/collection/Iterator;Lscala/Function1;)V (26 bytes) @ 0x00007f98808ca4a8 [0x00007f98808ca400+0xa8]
J 1969 C1 scala.collection.AbstractIterable.foreach(Lscala/Function1;)V (6 bytes) @ 0x00007f98808cabc4 [0x00007f98808ca960+0x264]
J 3059 C1 kafka.log.LogSegment.recover(Lkafka/log/ProducerStateManager;Lscala/Option;)I (175 bytes) @ 0x00007f9880ade2c4 [0x00007f9880adb840+0x2a84]
J 3143 C1 kafka.log.Log.kafka$log$Log$$recoverSegment(Lkafka/log/LogSegment;Lscala/Option;)I (124 bytes) @ 0x00007f98809750cc [0x00007f98809747e0+0x8ec]
j kafka.log.Log.recoverLog()J+132
J 3373 C1 kafka.log.Log.loadSegments()J (128 bytes) @ 0x00007f9880b99b84 [0x00007f9880b98400+0x1784]
j kafka.log.Log.<init>(Ljava/io/File;Lkafka/log/LogConfig;JJLkafka/utils/Scheduler;Lkafka/server/BrokerTopicStats;Lorg/apache/kafka/common/utils/Time;IILorg/apache/kafka/common/TopicPartition;Lkafka/log/ProducerStateManager;Lkafka/server/LogDirFailureChannel;)V+231
j kafka.log.Log$.apply(Ljava/io/File;Lkafka/log/LogConfig;JJLkafka/utils/Scheduler;Lkafka/server/BrokerTopicStats;Lorg/apache/kafka/common/utils/Time;IILkafka/server/LogDirFailureChannel;)Lkafka/log/Log;+46
j kafka.log.LogManager.kafka$log$LogManager$$loadLog(Ljava/io/File;Lscala/collection/Map;Lscala/collection/Map;)V+167
j kafka.log.LogManager$$anonfun$loadLogs$2$$anonfun$11$$anonfun$apply$15$$anonfun$apply$2.apply$mcV$sp()V+49
J 3372 C1 kafka.utils.CoreUtils$$anon$1.run()V (10 bytes) @ 0x00007f9880b83584 [0x00007f9880b83480+0x104]
J 3502 C1 java.util.concurrent.FutureTask.run()V (126 bytes) @ 0x00007f9880be1f7c [0x00007f9880be1ca0+0x2dc]
j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00007f97f0015800 JavaThread "kafka-scheduler-9" daemon [_thread_blocked, id=548, stack(0x00007f983005a000,0x00007f983015b000)]
0x00007f97f0017000 JavaThread "kafka-scheduler-8" daemon [_thread_blocked, id=547, stack(0x00007f983015b000,0x00007f983025c000)]
0x00007f97f401d000 JavaThread "kafka-scheduler-7" daemon [_thread_blocked, id=546, stack(0x00007f983025c000,0x00007f983035d000)]
0x00007f97f401c000 JavaThread "kafka-scheduler-6" daemon [_thread_blocked, id=545, stack(0x00007f983035d000,0x00007f983045e000)]
0x00007f97fc084800 JavaThread "kafka-scheduler-5" daemon [_thread_blocked, id=544, stack(0x00007f98304fe000,0x00007f98305ff000)]
0x00007f97fc07e800 JavaThread "kafka-scheduler-4" daemon [_thread_blocked, id=543, stack(0x00007f98540b1000,0x00007f98541b2000)]
0x00007f97fc07a000 JavaThread "kafka-scheduler-3" daemon [_thread_blocked, id=542, stack(0x00007f98544c0000,0x00007f98545c1000)]
0x00007f97f4017000 JavaThread "kafka-scheduler-2" daemon [_thread_blocked, id=541, stack(0x00007f98545c1000,0x00007f98546c2000)]
0x00007f97f0006800 JavaThread "kafka-scheduler-1" daemon [_thread_blocked, id=540, stack(0x00007f98546c2000,0x00007f98547c3000)]
0x00007f97fc077800 JavaThread "kafka-scheduler-0" daemon [_thread_blocked, id=539, stack(0x00007f98547c3000,0x00007f98548c4000)]
0x00007f9890c20000 JavaThread "pool-4-thread-3" [_thread_blocked, id=538, stack(0x00007f98548c4000,0x00007f98549c5000)]
=>0x00007f9890c1e000 JavaThread "pool-4-thread-2" [_thread_in_native_trans, id=537, stack(0x00007f98549c5000,0x00007f9854ac6000)]
0x00007f9890c11000 JavaThread "pool-4-thread-1" [_thread_blocked, id=536, stack(0x00007f9854ac6000,0x00007f9854bc7000)]
0x00007f9890bf5000 JavaThread "ThrottledRequestReaper-Request" [_thread_blocked, id=535, stack(0x00007f9854bc7000,0x00007f9854cc8000)]
0x00007f9890bf3800 JavaThread "ThrottledRequestReaper-Produce" [_thread_blocked, id=534, stack(0x00007f9854cc8000,0x00007f9854dc9000)]
0x00007f9890bf1800 JavaThread "ThrottledRequestReaper-Fetch" [_thread_blocked, id=533, stack(0x00007f9854dc9000,0x00007f9854eca000)]
0x00007f9890be0800 JavaThread "SensorExpiryThread" daemon [_thread_blocked, id=532, stack(0x00007f9854eca000,0x00007f9854fcb000)]
0x00007f9890a9c800 JavaThread "main-EventThread" daemon [_thread_blocked, id=531, stack(0x00007f98553cb000,0x00007f98554cc000)]
0x00007f9890a9b000 JavaThread "main-SendThread(rgibns1:2181)" daemon [_thread_in_native, id=530, stack(0x00007f98554cc000,0x00007f98555cd000)]
0x00007f9890a6b800 JavaThread "metrics-meter-tick-thread-2" daemon [_thread_blocked, id=529, stack(0x00007f98557cd000,0x00007f98558ce000)]
0x00007f9890a58800 JavaThread "metrics-meter-tick-thread-1" daemon [_thread_blocked, id=528, stack(0x00007f98558ce000,0x00007f98559cf000)]
0x00007f989079f000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=526, stack(0x00007f9855ed0000,0x00007f9855fd1000)]
0x00007f989078c800 JavaThread "RMI TCP Accept-43001" daemon [_thread_in_native, id=525, stack(0x00007f9855fd1000,0x00007f98560d2000)]
0x00007f989077b800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=524, stack(0x00007f98560d2000,0x00007f98561d3000)]
0x00007f98902f0800 JavaThread "Service Thread" daemon [_thread_blocked, id=523, stack(0x00007f9856ac0000,0x00007f9856bc1000)]
0x00007f98902d3800 JavaThread "C1 CompilerThread1" daemon [_thread_blocked, id=522, stack(0x00007f9856bc1000,0x00007f9856cc2000)]
0x00007f98902d1000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=521, stack(0x00007f9856cc2000,0x00007f9856dc3000)]
0x00007f98902cf000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=520, stack(0x00007f9856dc3000,0x00007f9856ec4000)]
0x00007f98902cd800 JavaThread "Surrogate Locker Thread (Concurrent GC)" daemon [_thread_blocked, id=519, stack(0x00007f9856ec4000,0x00007f9856fc5000)]
0x00007f989029b000 JavaThread "Finalizer" daemon [_thread_blocked, id=518, stack(0x00007f985715d000,0x00007f985725e000)]
0x00007f9890298800 JavaThread "Reference Handler" daemon [_thread_blocked, id=517, stack(0x00007f985725e000,0x00007f985735f000)]
0x00007f989000f800 JavaThread "main" [_thread_blocked, id=506, stack(0x00007f98962a2000,0x00007f98963a3000)]
Other Threads:
0x00007f989028e800 VMThread [stack: 0x00007f985735f000,0x00007f9857460000] [id=516]
0x00007f98907a4000 WatcherThread [stack: 0x00007f9855dcf000,0x00007f9855ed0000] [id=527]
VM state:synchronizing (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00007f989000bea0] Safepoint_lock - owner thread: 0x00007f989028e800
[0x00007f989000bf20] Threads_lock - owner thread: 0x00007f989028e800
[0x00007f989000c420] Heap_lock - owner thread: 0x00007f9890c20000
Heap:
garbage-first heap total 524288K, used 330445K [0x0000000080000000, 0x0000000080101000, 0x0000000100000000)
region size 1024K, 307 young (314368K), 1 survivors (1024K)
Metaspace used 22196K, capacity 22368K, committed 22784K, reserved 1069056K
class space used 2896K, capacity 2952K, committed 3072K, reserved 1048576K
---- Heap Regions: skip...
GC Heap History (10 events):
Event: 539.295 GC heap before
{Heap before GC invocations=1051 (full 0):
garbage-first heap total 524288K, used 330372K [0x0000000080000000, 0x0000000080101000, 0x0000000100000000)
region size 1024K, 307 young (314368K), 1 survivors (1024K)
Metaspace used 22196K, capacity 22368K, committed 22784K, reserved 1069056K
class space used 2896K, capacity 2952K, committed 3072K, reserved 1048576K
---- skip ...
Memory: 4k page, physical 8388608k(2892k free), swap 15997948k(14877228k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (25.191-b12) for linux-amd64 JRE (1.8.0_191-b12), built on Oct 6 2018 05:43:09 by "java_re" with gcc 7.3.0
time: Wed Jul 17 14:10:16 2019
elapsed time: 541 seconds (0d 0h 9m 1s)
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
[error occurred during error reporting , id 0xb]
[error occurred during error reporting , id 0xb]
[error occurred during error reporting , id 0xb]
[error occurred during error reporting , id 0xb]
skip same error message ...
[Too many errors, abort]
[Too many errors, abort]
[Too many errors, abort]
[Too many errors, abort]
有人遇到过吗？