在Hadoop中的shell $ ExitCodeException

时间:2015-04-03 09:50:48

标签: java hadoop mapreduce

我一直收到这个错误,我已多次尝试执行它。它显示相同的错误并重新执行约两次,然后退出

1 个答案:

答案 0 :(得分:0)

似乎远程运行作业时,yarn.application.classpath必须在配置中,否则作业将失败

要运行此作业,请使用此配置

Configuration configuration = new Configuration();
configuration.set(“fs.defaultFS”, “hdfs://192.168.195.161:8020″);
configuration.set(“hadoop.job.ugi”, “root”);
configuration.set(“mapreduce.framework.name”, “yarn”);
configuration.set(“yarn.resourcemanager.address”a “192.168.195.161:8050″);
configuration.set(“yarn.nodemanager.aux-services”, “mapreduce_shuffle”);

final String[] args = new String[] { };
ToolRunner.run(configuration, jobDriver, args);