Question

我按照these说明设置了一个小型Hadoop集群，但使用的是Hadoop版本2.7.4。集群似乎工作正常，但我无法运行mapreduce作业。特别是在尝试以下时

$HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.4.jar randomwriter outdenter code here

打印作业

17/11/27 16:35:21 INFO client.RMProxy: Connecting to ResourceManager at 
ec2-yyy.eu-central-
1.compute.amazonaws.com/xxx:8032
Running 0 maps.

Job started: Mon Nov 27 16:35:22 UTC 2017

17/11/27 16:35:22 INFO client.RMProxy: Connecting to ResourceManager at 
ec2-yyy.eu-central-
1.compute.amazonaws.com/xxx:8032


17/11/27 16:35:22 INFO mapreduce.JobSubmitter: number of splits:0

17/11/27 16:35:22 INFO mapreduce.JobSubmitter: Submitting tokens for 
job: job_1511799491035_0006

17/11/27 16:35:22 INFO impl.YarnClientImpl: Submitted application 
application_1511799491035_0006

17/11/27 16:35:22 INFO mapreduce.Job: The url to track the job: 
http://ec2-yyy.eu-central-
1.compute.amazonaws.com:8088/proxy/application_1511799491035_0006/

17/11/27 16:35:22 INFO mapreduce.Job: Running job: 
job_1511799491035_0006

并且永远不会超过这个状态。

我的yarn-site.xml如下所示

<configuration>
  <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property> 
  <property>
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  </property>
  <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>ec2-yyy.eu-central-1.compute.amazonaws.com</value>
    </property>
</configuration>

我的mapred-site.xml如下所示

<configuration>
  <property>
    <name>mapreduce.jobtracker.address</name>
    <value>ec2-yyy.eu-central-1.compute.amazonaws.com:54311</value>
  </property>
  <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
  </property>
</configuration>

您是否知道如何处理此问题？

由于 C14

hadoop集群没有运行mapreduce作业

0 个答案: