Hadoop:Mapreduce无法启动/运行

时间:2019-10-07 13:36:15

标签: hadoop hive mapreduce apache-pig

我是Hadoop的新手,请帮助

2019-10-07 18:44:46,563 [main]信息org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher-HadoopJobId:job_1569922894111_0023 2019-10-07 18:44:46,563 [main]信息org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher-处理别名旅行2019-10-07 18:44:46,563 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher-详细位置:M:trip [1,7],trip [-1,-1] C:R:2019-10-07 18:44:46,575 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer .MapReduceLauncher-0%完成2019-10-07 18:44:46,575 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher-正在运行的作业是[job_1569922894111_0023]

这是使用命令“ dump trip”后得到的;我已加载数据并存储在trip中。我猜MapReduce不在运行/启动。

mapred-site.xml

<configuration>
        <property>
            <name>mapreduce.framework.name</name>
            <value>yarn</value>
        </property>

    <property>
            <name>mapreduce.map.memory.mb</name>
            <value>1024</value>
        </property>

         <property>
            <name>mapreduce.reduce.memory.mb</name>
            <value>1024</value>
        </property>

        <property>
            <name>mapreduce.reduce.cpu.vcores</name>
            <value>2</value>
            <description>The number of virtual cores required for each map task.</description>
        </property>

         <property>
            <name>mapreduce.reduce.cpu.vcores</name>
            <value>2</value>
            <description>The number of virtual cores required for each map task.</description>
        </property>
    </configuration>


yarn-site.xml

<configuration>

    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
    <property>
        <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
        <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
    <property>
       <name>yarn.resourcemanager.hostname</name>
       <value>0.0.0.0</value>
    </property>
</configuration>

0 个答案:

没有答案