我正在使用 - Multinode Hadoop配置。
我的笔记本电脑 - 用作名称节点-116.202.217.25
VMPayer Ubuntu图像 - 数据节点。 -172.16.197.128
名称节点 - > / etc / hosts条目(我添加了第2行)
116.202.217.25 masterNode
172.16.197.128 slaveNode
127.0.0.1 localhost
127.0.1.1 Shankha-Bhattacharya-Toshiba
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
数据节点m / c / etc / hosts条目(我添加了slaveNode和masterNode条目)
127.0.0.1 localhost
127.0.1.1 ubuntu
172.16.197.128 slaveNode
116.202.217.25 masterNode
# The following lines are desirable for IPv6 capable hosts
#::1 ip6-localhost ip6-loopback
#fe00::0 ip6-localnet
#ff00::0 ip6-mcastprefix
#ff02::1 ip6-allnodes
#ff02::2 ip6-allrouters
现在我在名称节点(笔记本电脑)和VM(数据节点)中的所有配置文件中使用masterNode和slaveNode
示例 - core-site.xml
fs.default.name
hdfs://masterNode:54310
mapred-site.xml中
mapred.job.tracker
masterNode:54311
命名节点JPS
hadoop@Shankha-Bhattacharya-Toshiba:~/hadoop-1.0.3/bin$ jps
7844 NameNode
8135 SecondaryNameNode
15719 Jps
8287 JobTracke
数据节点JPS
hadoop@ubuntu:~$ jps
3148 TaskTracker
2933 DataNode
3804 Jps
打开网址 - masternode:50070 / dfshealth.jsp
然后当我点击浏览文件系统链接时,我得到以下异常
Page redirected to -
masternode:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=/
Exception -
Unable to connect
Firefox can't establish a connection to the server at masternode:50075.
The site could be temporarily unavailable or too busy. Try again in a few moments.
If you are unable to load any pages, check your computer's network connection.
If your computer or network is protected by a firewall or proxy, make sure that Firefox is permitted to access the Web.
如何解决此问题?
另一个问题
hadoop dfsadmin -report - 显示数据节点是我的NameNode(masterNode) ...我在哪里配置VM - 作为我的数据节点..
hadoop@Shankha-Bhattacharya-Toshiba:~/hadoop-1.0.3/bin$ ./hadoop dfsadmin -report
Warning: $HADOOP_HOME is deprecated.
Configured Capacity: 42176413696 (39.28 GB)
Present Capacity: 36319903744 (33.83 GB)
DFS Remaining: 36319870976 (33.83 GB)
DFS Used: 32768 (32 KB)
DFS Used%: 0%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
-------------------------------------------------
Datanodes available: 1 (1 total, 0 dead)
Name: 116.202.217.25:50010
Decommission Status : Normal
Configured Capacity: 42176413696 (39.28 GB)
DFS Used: 32768 (32 KB)
Non DFS Used: 5856509952 (5.45 GB)
DFS Remaining: 36319870976(33.83 GB)
DFS Used%: 0%
DFS Remaining%: 86.11%
Last contact: Mon Jun 16 16:33:27 IST 2014
在NameNode(MasterNode)中 - 在主文件中 - 我添加 masterNode
在NameNode(MasterNode)中 - 在从属文件中我添加 slaveNode
那为什么数据节点名称显示名称:116.202.217.25:50010,而不是172.16.197.128(slave / datanode ip)?