我是EMR的新手,每当我运行一份工作时,我都会在syslog中收到此错误:
2014-05-27 03:59:57,220 INFO org.apache.hadoop.mapreduce.Job (main): Job job_1401143947501_0009 failed with state FAILED due to: Application application_1401143947501_0009 failed 2 times due to AM Container for appattempt_1401143947501_0009_000002 exited with exitCode: 1 due to: Exception from container-launch:
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
at org.apache.hadoop.util.Shell.run(Shell.java:379)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
我不知道这意味着什么以及我应该研究什么。我看了很多,似乎有很多不同的意见。有人建议从yarn-site.xml中删除yarn.application.classpath和/或在同一文件中更改yarn.nodemanager.resource.memory-mb。但到目前为止还没有任何工作。我觉得我在黑暗中拍摄。如果有人可以指出我应该寻找什么,那么它将非常有用。
提前致谢