需要帮助配置Hadoop 0.23.8

时间:2013-06-19 04:49:36

标签: hadoop hdfs

我正在尝试在我的本地计算机上配置hadoop-0.23.8。而且我遇到了以下异常。你们知道我做错了吗

我正在使用以下系统var

export HADOOP_OPTS="-Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk"

我也使用java 6并设置了以下变量HADOOP_PREFIX,HADOOP_HDFS_HOME和YARN_HOME。你能帮忙正确配置吗?

192.168.1.13: namenode running as process 10522. Stop it first.
hduser@192.168.1.13: starting datanode, logging to /usr/local/hadoop-0.23.8/logs/hadoop-
hduser-datanode-MacBook-Air.local.out
hduser@192.168.1.13: 2013-06-19 00:30:30.556 java[11171:1603] Unable to load realm info from SCDynamicStore
hduser@192.168.1.13: 2013-06-19 00:30:30.558 java[11171:1603] Unable to load realm info from SCDynamicStore
Starting secondary namenodes []
hduser@192.168.1.13: starting secondarynamenode, logging to /usr/local/hadoop-0.23.8/logs/hadoop-hduser-secondarynamenode-MacBook-Air.local.out
hduser@192.168.1.13: Exception in thread "main" java.lang.IllegalArgumentException: Target address cannot be null.
hduser@192.168.1.13:    at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:179)
hduser@192.168.1.13:    at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:154)
hduser@192.168.1.13:    at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:143)
hduser@192.168.1.13:    at org.apache.hadoop.hdfs.DFSUtil.getNameServiceId(DFSUtil.java:771)
hduser@192.168.1.13:    at org.apache.hadoop.hdfs.DFSUtil.getSecondaryNameServiceId(DFSUtil.java:738)
hduser@192.168.1.13:    at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>(SecondaryNameNode.java:186)
hduser@192.168.1.13:    at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:691)

1 个答案:

答案 0 :(得分:1)

所以我的一个配置文件中有一个小错误,对此抱歉,但我找到了配置hadoop 0.23.8的一些重要信息。在etc / hadoop文件夹中创建一个名为hadoop-env.sh的文件,其中放置了JAVA_HOME,HADOOP_OPTS。等