为什么我的CPU花费的时间和其他柜台没出现? [Hadoop 2.7.1]

时间:2017-07-10 07:21:55

标签: hadoop counter hadoop2

这是我在运行mapreduce工作时从柜台得到的。

如何在终端中显示其他计数器,如CPU Time Spent,物理内存(字节),虚拟内存(字节)等?

文件系统计数器

.txt

Map-Reduce Framework

    FILE: Number of bytes read=615414

    FILE: Number of bytes written=1469792

    FILE: Number of read operations=0

    FILE: Number of large read operations=0

    FILE: Number of write operations=0

    HDFS: Number of bytes read=7948610

    HDFS: Number of bytes written=216734

    HDFS: Number of read operations=13

    HDFS: Number of large read operations=0

    HDFS: Number of write operations=4

随机播放错误

    Map input records=32562

    Map output records=488415

    Map output bytes=5927964

    Map output materialized bytes=304438

    Input split bytes=110

    Combine input records=488415

    Combine output records=22055

    Reduce input groups=22055

    Reduce shuffle bytes=304438

    Reduce input records=22055

    Reduce output records=22055

    Spilled Records=44110

    Shuffled Maps =1

    Failed Shuffles=0

    Merged Map outputs=1

    GC time elapsed (ms)=346

    Total committed heap usage (bytes)=554172416

文件输入格式计数器

    BAD_ID=0

    CONNECTION=0

    IO_ERROR=0

    WRONG_LENGTH=0

    WRONG_MAP=0

    WRONG_REDUCE=0

文件输出格式计数器

    Bytes Read=3974305

感谢您的关注。

0 个答案:

没有答案