for i don't know why the Exception from container-launch: ExitCodeException exitCode=1;
[root @ hadoop-senior hadoop-2.5.0] #bin / yarn jar jsrs / mr-worcount.jar / user / centos / mapreduce / wordcount / input / user / centos / mapreduce / wordcount / output4
17/01/11 04:24:14 WARN util.NativeCodeLoader:无法为您的平台加载native-hadoop库...使用适用的builtin-java类 17/01/11 04:24:14 INFO client.RMProxy:在/192.168.85.129:8032连接到ResourceManager 17/01/11 04:24:15 WARN mapreduce.JobSubmitter:未执行Hadoop命令行选项解析。实现Tool接口并使用ToolRunner执行您的应用程序以解决此问题。 17/01/11 04:24:15 WARN mapreduce.JobSubmitter:没有工作jar文件集。可能找不到用户类。请参阅作业或作业#setJar(String)。 17/01/11 04:24:15 INFO input.FileInputFormat:要处理的总输入路径:1 17/01/11 04:24:15 INFO mapreduce.JobSubmitter:拆分次数:1 17/01/11 04:24:16 INFO mapreduce.JobSubmitter:提交工作代币:job_1484121450974_0004 17/01/11 04:24:16 INFO mapred.YARNRunner:工作罐不存在。不将任何jar添加到资源列表中。 17/01/11 04:24:16 INFO impl.YarnClientImpl:提交的应用程序application_1484121450974_0004 17/01/11 04:24:16 INFO mapreduce.Job:跟踪工作的网址:http://hadoop-senior:8088/proxy/application_1484121450974_0004/ 17/01/11 04:24:16 INFO mapreduce.Job:正在运行的职位:job_1484121450974_0004 17/01/11 04:24:23 INFO mapreduce.Job:作业job_1484121450974_0004以超级模式运行:false 17/01/11 04:24:23 INFO mapreduce.Job:地图0%减少0% 17/01/11 04:24:26 INFO mapreduce.Job:任务ID:attempt_1484121450974_0004_m_000000_0,状态:未通过 容器启动的异常:ExitCodeException exitCode = 1: ExitCodeException exitCode = 1: 在org.apache.hadoop.util.Shell.runCommand(Shell.java:538) 在org.apache.hadoop.util.Shell.run(Shell.java:455) 在org.apache.hadoop.util.Shell $ ShellCommandExecutor.execute(Shell.java:702) 在org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195) 在org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300) 在org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81) at java.util.concurrent.FutureTask.run(FutureTask.java:266) 在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:617) 在java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
17/01/11 04:24:29 INFO mapreduce.Job: Task Id : attempt_1484121450974_0004_m_000000_1, Status : FAILED
Exception from container-launch: ExitCodeException exitCode=1:
ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
17/01/11 04:24:33 INFO mapreduce.Job: Task Id : attempt_1484121450974_0004_m_000000_2, Status : FAILED
Exception from container-launch: ExitCodeException exitCode=1:
ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
17/01/11 04:24:38 INFO mapreduce.Job: map 100% reduce 100%
17/01/11 04:24:39 INFO mapreduce.Job: Job job_1484121450974_0004 failed with state FAILED due to: Task failed task_1484121450974_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
17/01/11 04:24:39 INFO mapreduce.Job: Counters: 12
Job Counters enter code here
Failed map tasks=4
Launched map tasks=4
Other local map tasks=3
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=4775
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=4775
Total vcore-seconds taken by all map tasks=4775
Total megabyte-seconds taken by all map tasks=4889600
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
答案 0 :(得分:0)
this is logs
2017-01-09 22:53:40,282 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: registered UNIX signal handlers for [TERM, H
UP, INT]
2017-01-09 22:53:42,975 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform.
.. using builtin-java classes where applicable
2017-01-09 22:53:43,299 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: JobHistory Init
2017-01-09 22:53:43,790 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:54:13,805 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:54:43,819 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:55:13,828 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:55:43,835 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:56:13,846 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:56:43,858 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:57:13,865 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Waiting for FileSystem at hadoop-senior:80
20to be available
2017-01-09 22:57:44,312 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Initializing Existing Jobs...
2017-01-09 22:57:44,391 INFO org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage: CachedHistoryStorage Init
2017-01-09 22:57:44,429 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockin
gQueue
2017-01-09 22:57:44,446 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.hs.server.HSAd
minServer failed in state INITED; cause: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: A
ddress already in use; For more details see: http://wiki.apache.org/hadoop/BindException
java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For more details s
ee: http://wiki.apache.org/hadoop/BindException
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
at org.apache.hadoop.ipc.Server.bind(Server.java:419)
at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
2017-01-09 22:57:44,449 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.hs.JobHistoryS
erver failed in state INITED; cause: org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding
to [0.0.0.0:10033] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/Bind
Exception
org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindExce
ption: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException
at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
Caused by: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For mor
e details see: http://wiki.apache.org/hadoop/BindException
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
at org.apache.hadoop.ipc.Server.bind(Server.java:419)
at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
... 5 more
2017-01-09 22:57:44,450 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: Stopping JobHistory
2017-01-09 22:57:44,451 FATAL org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting JobHistoryServer
org.apache.hadoop.service.ServiceStateException: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindExce
ption: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException
at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172)
at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:142)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:219)
at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:229)
Caused by: java.net.BindException: Problem binding to [0.0.0.0:10033] java.net.BindException: Address already in use; For mor
e details see: http://wiki.apache.org/hadoop/BindException
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
at org.apache.hadoop.ipc.Server.bind(Server.java:419)
at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
at org.apache.hadoop.mapreduce.v2.hs.server.HSAdminServer.serviceInit(HSAdminServer.java:100)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
... 5 more
2017-01-09 22:57:44,456 INFO org.apache.hadoop.util.ExitUtil: Exiting with status -1
2017-01-09 22:57:44,459 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down JobHistoryServer at hadoop-senior/192.168.85.129