Question

我使用（brew install hadoop）安装了hadoop。 4个月它运行正常。我意识到mapred-site.xml配置为jobtracker所以。我改为纱线并重新启动然后我发现数据节点丢失了。我重新安装了hadoop并发现了一些损坏的文件。我使用fsck删除了这些文件。但名称节点仍将保持安全模式。我尝试重新安装hadoop 5次，我也卸载了brew并重新安装了所有新鲜的。我仍然无法弄明白。任何帮助将不胜感激。我的作业将于本周完成。

jps

28723 SecondaryNameNode
33876 Jps
16309 NameNode
28504 NameNode
28856 ResourceManager
61292 JoveScala
32701 DataNode
28958 NodeManager

core-site.xml

 <property>
  <name>hadoop.tmp.dir</name>
  <value>/usr/local/Cellar/hadoop/hdfs/tmp</value>
</property>
<property>
    <name>fs.defaultFS</name>
    <value>hdfs://localhost:9000</value>
</property>

hdfs-site.xml

<property>
    <name>dfs.replication</name>
    <value>1</value>
</property>

mapred-site.xml中

   <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
</property>

yarn-site.xml

   <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
</property>

bin / hdfs dfsadmin -report

    Safe mode is ON
    Configured Capacity: 120124866560 (111.88 GB)
    Present Capacity: 40319258624 (37.55 GB)
    DFS Remaining: 40319250432 (37.55 GB)
    DFS Used: 8192 (8 KB)
    DFS Used%: 0.00%
    Under replicated blocks: 0
    Blocks with corrupt replicas: 0
    Missing blocks: 0
    Missing blocks (with replication factor 1): 26
    -------------------------------------------------
    Live datanodes (1):

    Name: 127.0.0.1:50010 (localhost)
    Hostname: 192.168.0.15
    Decommission Status : Normal
    Configured Capacity: 120124866560 (111.88 GB)
    DFS Used: 8192 (8 KB)
    Non DFS Used: 79805607936 (74.32 GB)
    DFS Remaining: 40319250432 (37.55 GB)
    DFS Used%: 0.00%
    DFS Remaining%: 33.56%
    Configured Cache Capacity: 0 (0 B)
    Cache Used: 0 (0 B)
    Cache Remaining: 0 (0 B)
    Cache Used%: 100.00%
    Cache Remaining%: 0.00%
    Xceivers: 1
    Last contact: Fri Jan 13 11:41:49 PST 2017

hdfs fsck / | egrep -v'^。+ $'| grep -v eplica

    Connecting to namenode via            http://localhost:50070/fsckugi=krishnaprasad&path=%2F
    FSCK started by krishnaprasad (auth:SIMPLE) from /127.0.0.1 for    path / at Fri Jan 13 12:07:11 PST 2017
     Status: HEALTHY
     Total size:    0 B
     Total dirs:    1
     Total files:   0
     Total symlinks:        0
     Total blocks (validated):  0
     Corrupt blocks:        0
     Number of data-nodes:      1
     Number of racks:       1
     FSCK ended at Fri Jan 13 12:07:11 PST 2017 in 3 milliseconds
     The filesystem under path '/' is HEALTHY

名称节点永远不会离开安全模式，尽管没有文件被破坏，jps显示名称节点两次

0 个答案: