INFO org.apache.hadoop.service.AbstractService:服务org.apache.hadoop.mapreduce.v2.hs.server.HSAd minServer在状态INITED失败;

时间:2017-01-11 13:06:11

标签: hadoop

  for i  don't know why the   Exception from container-launch: ExitCodeException exitCode=1;

[root @ hadoop-senior hadoop-2.5.0] #bin / yarn jar jsrs / mr-worcount.jar / user / centos / mapreduce / wordcount / input / user / centos / mapreduce / wordcount / output4

17/01/11 04:24:14 WARN util.NativeCodeLoader:无法为您的平台加载native-hadoop库...使用适用的builtin-java类     17/01/11 04:24:14 INFO client.RMProxy:在/192.168.85.129:8032连接到ResourceManager     17/01/11 04:24:15 WARN mapreduce.JobSubmitter:未执行Hadoop命令行选项解析。实现Tool接口并使用ToolRunner执行您的应用程序以解决此问题。     17/01/11 04:24:15 WARN mapreduce.JobSubmitter:没有工作jar文件集。可能找不到用户类。请参阅作业或作业#setJar(String)。     17/01/11 04:24:15 INFO input.FileInputFormat:要处理的总输入路径:1     17/01/11 04:24:15 INFO mapreduce.JobSubmitter:拆分次数:1     17/01/11 04:24:16 INFO mapreduce.JobSubmitter:提交工作代币:job_1484121450974_0004     17/01/11 04:24:16 INFO mapred.YARNRunner:工作罐不存在。不将任何jar添加到资源列表中。     17/01/11 04:24:16 INFO impl.YarnClientImpl:提交的应用程序application_1484121450974_0004     17/01/11 04:24:16 INFO mapreduce.Job:跟踪工作的网址:http://hadoop-senior:8088/proxy/application_1484121450974_0004/     17/01/11 04:24:16 INFO mapreduce.Job:正在运行的职位:job_1484121450974_0004     17/01/11 04:24:23 INFO mapreduce.Job:作业job_1484121450974_0004以超级模式运行:false     17/01/11 04:24:23 INFO mapreduce.Job:地图0%减少0%     17/01/11 04:24:26 INFO mapreduce.Job:任务ID:attempt_1484121450974_0004_m_000000_0,状态:未通过     容器启动的异常:ExitCodeException exitCode = 1:     ExitCodeException exitCode = 1:             在org.apache.hadoop.util.Shell.runCommand(Shell.java:538)             在org.apache.hadoop.util.Shell.run(Shell.java:455)             在org.apache.hadoop.util.Shell $ ShellCommandExecutor.execute(Shell.java:702)             在org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)             在org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)             在org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)             at java.util.concurrent.FutureTask.run(FutureTask.java:266)             在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)             at java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:617)             在java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 1

17/01/11 04:24:29 INFO mapreduce.Job: Task Id : attempt_1484121450974_0004_m_000000_1, Status : FAILED
Exception from container-launch: ExitCodeException exitCode=1: 
ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
        at org.apache.hadoop.util.Shell.run(Shell.java:455)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1

17/01/11 04:24:33 INFO mapreduce.Job: Task Id : attempt_1484121450974_0004_m_000000_2, Status : FAILED
Exception from container-launch: ExitCodeException exitCode=1: 
ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
        at org.apache.hadoop.util.Shell.run(Shell.java:455)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1

17/01/11 04:24:38 INFO mapreduce.Job:  map 100% reduce 100%
17/01/11 04:24:39 INFO mapreduce.Job: Job job_1484121450974_0004 failed with state FAILED due to: Task failed task_1484121450974_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

17/01/11 04:24:39 INFO mapreduce.Job: Counters: 12
        Job Counters enter code here
                Failed map tasks=4
                Launched map tasks=4
                Other local map tasks=3
                Data-local map tasks=1
                Total time spent by all maps in occupied slots (ms)=4775
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=4775
                Total vcore-seconds taken by all map tasks=4775
                Total megabyte-seconds taken by all map tasks=4889600
        Map-Reduce Framework
                CPU time spent (ms)=0
                Physical memory (bytes) snapshot=0
                Virtual memory (bytes) snapshot=0

1 个答案:

答案 0 :(得分:0)

this is logs
2017-01-09 22:53:40,282 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: registered UNIX signal handlers for [TERM, H
UP, INT]
2017-01-09 22:53:42,975 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform.
.. using builtin-java classes where applicable
2017-01-09 22:53:43,299 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: JobHistory Init
2017-01-09 22:53:43,790 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:54:13,805 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:54:43,819 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:55:13,828 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:55:43,835 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:56:13,846 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:56:43,858 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:57:13,865 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:57:44,312 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Initializing Existing Jobs...
2017-01-09 22:57:44,391 INFO org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage: CachedHistoryStorage Init
2017-01-09 22:57:44,429 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockin
gQueue
2017-01-09 22:57:44,446 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.hs.server.HSAd
minServer failed in state INITED; cause: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: A
ddress already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For more details s
ee:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
        at org.apache.hadoop.ipc.Server.bind(Server.java:419)
        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
        at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
        at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
        at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
2017-01-09 22:57:44,449 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.hs.JobHistoryS
erver failed in state INITED; cause: org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding
 to [0.0.0.0:10033] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/Bind
Exception
org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindExce
ption: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
Caused by: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For mor
e details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
        at org.apache.hadoop.ipc.Server.bind(Server.java:419)
        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
        at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
        at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
        at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        ... 5 more
2017-01-09 22:57:44,450 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: Stopping JobHistory
2017-01-09 22:57:44,451 FATAL org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting JobHistoryServer
org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindExce
ption: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
        at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
Caused by: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For mor
e details see:  http://wiki.apache.org/hadoop/BindException
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
        at org.apache.hadoop.ipc.Server.bind(Server.java:419)
        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
        at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
        at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
        at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
        at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        ... 5 more
2017-01-09 22:57:44,456 INFO org.apache.hadoop.util.ExitUtil: Exiting with status -1
2017-01-09 22:57:44,459 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down JobHistoryServer at hadoop-senior/192.168.85.129