Whirr:hadoop-proxy.sh无法正常工作

时间:2013-11-29 13:22:58

标签: hadoop amazon-ec2 apache-whirr

我安装了Whirr并创建了一个EC2集群。正确创建了集群,我可以ssh到节点并检查Hadoop是否正常工作。但是,每当我尝试使用hadoop-proxy.sh时,我都会收到以下消息:

bind: Cannot assign requested address

如果我尝试在不同的shell中看到HDFS(我之前已经配置了HADOOP_CONF_DIR变量),我会收到以下错误:

13/11/29 05:15:09 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively
Bad connection to FS. command aborted. exception: Server IPC version 7 cannot communicate with client version 4

我在设置群集时尝试使用不同的属性文件,使用CDH,而不使用它...但我仍然得到相同的错误。这是我目前用于使用Whirr启动集群的属性文件:

whirr.cluster-name=otrotest
whirr.instance-templates=1 hadoop-namenode+yarn-resourcemanager+mapreduce-historyserver,2 hadoop-datanode+yarn-nodemanager
whirr.provider=aws-ec2
whirr.identity=MY_ID
whirr.credential=MY_SECRET_KEY
whirr.private-key-file=/home/hduser/.ssh/whirr_id_rsa
whirr.public-key-file=/home/hduser/.ssh/whirr_id_rsa.pub
whirr.env.MAPREDUCE_VERSION=2
whirr.env.repo=cdh4
whirr.hadoop.install-function=install_cdh_hadoop
whirr.hadoop.configure-function=configure_cdh_hadoop
whirr.mr_jobhistory.start-function=start_cdh_mr_jobhistory
whirr.yarn.configure-function=configure_cdh_yarn
whirr.yarn.start-function=start_cdh_yarn
whirr.hardware-id=t1.micro
whirr.image-id=us-west-2/ami-6aad335a
whirr.location-id=us-west-2
whirr.java.install-function=install_openjdk
whirr.java.install-function=install_oab_java

我是Whirr的新手,我想我错过了一些东西......但我不知道如何解决这个问题。任何帮助将非常感激。提前谢谢。

0 个答案:

没有答案