在MapReduce处理多个作业期间,Yarn确实崩溃并且作业处理已停止。 在杀死正在运行的工作(2jobs)之后,我成功地支持了处理。 在我从崩溃开始时找到的日志中:
Max number of completed apps kept in state store met*: maxCompletedAppsInStateStore = 10000, removing app application_1500982512144_26754 from state store.
2017-08-25 03:50:05,799 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager: *Application should be expired, max number of completed apps kept in memory met*: maxCompletedAppsInMemory = 10000, removing app application_1500982512144_26754 from memory
之后,此消息在日志中显示多次:
Large response size 4742320 for call org.apache.hadoop.yarn.api.ApplicationClientProtocolPB.getApplications
您对这个问题有任何解释和解决方案吗?