Hadoop作业和任务跟踪器无法正常工作

时间:2014-04-09 12:06:44

标签: hadoop configuration hdfs

当我启动hadoop作业跟踪器和任务跟踪器不工作时。

我正在使用两台电脑。 master-furkanb @ master 192.168.2.135和slave-detay @ slave 192.168.2.250。

xml并在2台计算机上托管相同的文件。

我已写入控制台jps。

JPS

15568 Jps 12126 SecondaryNameNode 11812 NameNode 11934 DataNode 12314 ResourceManager

我的主机文件

的/ etc /主机

  

127.0.0.1 localhost

     

127.0.1.1 ubuntu.ubuntu-domain ubuntu

     

192.168.2.135 master

     

192.168.2.250奴隶

芯-site.xml中

<configuration>

<property>
   <name>fs.default.name</name>
   <value>hdfs://master:54310</value>
</property>

</configuration>

HDFS-site.xml中

<configuration>
<property>
   <name>dfs.replication</name>
   <value>2</value>
</property>
</configuration>

mapred-site.xml中

<configuration>

<property>
   <name>mapred.job.tracker</name>
   <value>master:54311</value>
</property>

<property>
   <name>mapreduce.framework.name</name>
   <value>yarn</value>
</property>

</configuration>

纱-site.xml中

<configuration>
 <property>
 <name>yarn.nodemanager.aux-services</name>
 <value>mapreduce.shuffle</value>
 </property>
 <property>
 <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
 <value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
</configuration>

Master Machine:

  

/ etc / hadoop / masters furkanb @ master

     

/ etc / hadoop / slaves furkanb @ master detay @ slave

奴隶机:

  

/ etc / hadoop / slaves localhost

当我在控制台上写start-all.sh时:

This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
14/04/09 14:52:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [master]
master: starting namenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-namenode-master.out
furkanb@master: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-datanode-master.out
detay@slave: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-detay-datanode-slave.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-secondarynamenode-master.out
14/04/09 14:53:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-resourcemanager-master.out
furkanb@master: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-nodemanager-master.out
detay@slave: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-detay-nodemanager-slave.out

我可以访问localhost:50070和master:50070。但我无法访问localhost:50030或master:50030

1 个答案:

答案 0 :(得分:2)

你正在使用Yarn而不是经典的mapreduce。你在这里找不到Jobtracker。要检查正在运行的应用程序的状态,您需要使用资源管理器的http端口。即8088

查看以下网址 本地主机:8088