如何阅读`hadoop dfsadmin -report`输出

时间:2016-08-11 23:23:23

标签: hadoop hdfs bigdata

命令:

[hdfs@sandbox oozie]$ hadoop dfsadmin -report|head -n 100

输出:

DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Configured Capacity: 44716605440 (41.65 GB)
Present Capacity: 31614091245 (29.44 GB)
DFS Remaining: 30519073792 (28.42 GB)
DFS Used: 1095017453 (1.02 GB)
DFS Used%: 3.46%
Under replicated blocks: 657
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0

-------------------------------------------------
Live datanodes (1):

Name: 10.0.2.15:50010 (sandbox.hortonworks.com)
Hostname: sandbox.hortonworks.com
Decommission Status : Normal
Configured Capacity: 44716605440 (41.65 GB)
DFS Used: 1095017453 (1.02 GB)
Non DFS Used: 13102514195 (12.20 GB)
DFS Remaining: 30519073792 (28.42 GB)
DFS Used%: 2.45%
DFS Remaining%: 68.25%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 4
Last contact: Thu Aug 11 23:12:04 UTC 2016

什么是缓存使用%,非DFS特别使用???

1 个答案:

答案 0 :(得分:1)

hdfs dfsadmin -report命令:

  

报告基本文件系统信息和统计信息。可选标志   可用于过滤显示的DataNode列表。

..来自hadoop的官方page

关于,

  1. 使用缓存%:
  2. 这取决于"配置的缓存容量"。它是配置值的百分比。由于您尚未为缓存配置任何空间,因此显示为100%(0 B中的0 B)

    1. 使用NonDFS:
    2. 使用以下公式计算

      NonDFS used = Configured Capacity - DFS Used - DFS Remaining