Question

我对hadoop很新。最近安装了它，现在尝试使用以下命令运行我的第一份工作（来自教程）

bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar grep input output 'dfs[a-z.]+'

然而，这项工作正处于暂停状态

16/12/09 12:26:55 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/12/09 12:26:56 INFO input.FileInputFormat: Total input paths to process : 0
16/12/09 12:26:56 INFO mapreduce.JobSubmitter: number of splits:0
16/12/09 12:26:56 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1481239473466_0006
16/12/09 12:26:56 INFO impl.YarnClientImpl: Submitted application application_1481239473466_0006
16/12/09 12:26:56 INFO mapreduce.Job: The url to track the job: http://Emrahs-MacBook-Pro.local:8088/proxy/application_1481239473466_0006/
16/12/09 12:26:56 INFO mapreduce.Job: Running job: job_1481239473466_0006

我在一些类似的问题上看到mapred-site.xml和yarn-site.xml可能是相关的。这些文件的内容是

mapred-site.xml中

<configuration> 
    <property>   
        <name>mapreduce.framework.name</name>  
        <value>yarn</value>  
    </property>   
    <property>  
        <name>yarn.app.mapreduce.am.resource.mb</name>  
        <value>1228</value>
    </property>
    <property> 
        <name>yarn.app.mapreduce.am.command-opts</name> 
        <value>-Xmx983m</value>
    </property>
    <property>
        <name>mapreduce.map.memory.mb</name>
        <value>1228</value>
    </property>
    <property>
        <name>mapreduce.reduce.memory.mb</name>
        <value>1228</value>
    </property>
    <property>
        <name>mapreduce.map.java.opts</name>
        <value>-Xmx983m</value>
    </property>
    <property>
        <name>mapreduce.reduce.java.opts</name>
        <value>-Xmx983m</value>
    </property>
</configuration>

纱-site.xml中

<configuration>

<!-- Site specific YARN configuration properties -->
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    <property> 
        <name>yarn.scheduler.minimum-allocation-mb</name> 
        <value>1228</value>
    </property>
    <property> 
        <name>yarn.scheduler.maximum-allocation-mb</name> 
        <value>9830</value>
    </property>
    <property> 
        <name>yarn.nodemanager.resource.memory-mb</name> 
        <value>9830</value>
    </property>
</configuration>

我在hadoop仪表板上查看了节点故障或缺少磁盘但是看不出有什么问题。任何帮助将不胜感激亲切的问候

MapReduce挂起作业

0 个答案: