这是我在运行mapreduce工作时从柜台得到的。
如何在终端中显示其他计数器,如CPU Time Spent,物理内存(字节),虚拟内存(字节)等?
文件系统计数器
.txt
Map-Reduce Framework
FILE: Number of bytes read=615414
FILE: Number of bytes written=1469792
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=7948610
HDFS: Number of bytes written=216734
HDFS: Number of read operations=13
HDFS: Number of large read operations=0
HDFS: Number of write operations=4
随机播放错误
Map input records=32562
Map output records=488415
Map output bytes=5927964
Map output materialized bytes=304438
Input split bytes=110
Combine input records=488415
Combine output records=22055
Reduce input groups=22055
Reduce shuffle bytes=304438
Reduce input records=22055
Reduce output records=22055
Spilled Records=44110
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=346
Total committed heap usage (bytes)=554172416
文件输入格式计数器
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
文件输出格式计数器
Bytes Read=3974305
感谢您的关注。