Question

我已经在Ubuntu上成功运行Hadoop 2.2.0版了几个星期了。我之前的经历是1.0.1。我正在运行Ubuntu 13.10，安装了全新的安装和build-essential以及手动安装的Hadoop环境。这个Ubuntu盒子也有一个运行成功的LAMP环境。我开始使用wordcount并在示例之外构建了模式匹配功能。这一切都按预期编译和执行。但是我有一个最近开发的问题。我无法让ResourceManager成功绑定到8088。

yarn-site.xml文件中没有任何变化。

<property>
<name>yarn.resourcemanager.address</name>
    <value>superghdp220:8088</value>
</property>

Hostname正确返回，我的IP地址在ifconfig中签出，hosts文件与该IP地址匹配。

Apache在端口80上运行并返回“It Works！”旗帜。

jps的输出低于

hduser@superghdp220:/usr/local/hadoop$ jps
19876 NameNode
20741 Jps
19997 DataNode
20175 SecondaryNameNode
20479 NodeManager

sudo netstat -an | grep ':8088'的输出返回NULL

sudo netstat -a -t --numeric-ports -p的输出返回所有绑定端口，但8088不在列表中。

最后这里是有用的最后输出行yarn-hduser-resourcemanager-superghdp220.log

org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.ContainerAllocationExpirer thread interrupted
2014-04-03 11:17:27,638 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [superghdp220:8088] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
    at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:139)
    at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65)
    at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54)
    at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.serviceStart(ClientRMService.java:149)
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
    at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
    at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:671)
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
    at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:872)
Caused by: java.net.BindException: Problem binding to [superghdp220:8088] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
    at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
    at org.apache.hadoop.ipc.Server.bind(Server.java:422)
    at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:534)
    at org.apache.hadoop.ipc.Server.<init>(Server.java:2203)
    at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
    at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
    at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
    at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169)
    at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132)
    ... 8 more
2014-04-03 11:17:27,655 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at superghdp220/192.168.137.160
************************************************************/

非常感谢任何见解或帮助。谢谢阅读，专利

Answer 1

8088默认由“ yarn.resourcemanager.webapp.address”使用（您可以查看此文档以获取更多详细信息：https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml）

因此您可以尝试更改yarn.resourcemanager.webapp.address或yarn.resourcemanager.address中的端口

Hadoop 2.2.0 ResourceManager无法绑定到端口8088

1 个答案: