从hadoop控制台输出中删除调试日志

时间:2013-02-22 17:47:46

标签: logging hadoop console mapreduce config

我想从我的hadoop控制台输出中删除DEBUG消息。我已经设置了

 export HADOOP_ROOT_LOGGER=WARN,DRFA
 export HADOOP_JHS_LOGGER=WARN,DRFA
在hadoop-env.sh文件和

hadoop.root.logger=WARN,console
hadoop.security.logger=WARN,console

在hadoop / bin的log4j.properties文件中

目前我跑步的时候     的 hadoop fs -lsr /directory/  输出如下。我只想查看实际的文件而不是所有的debug / info语句。谢谢。

12:03:58.408 [sendParams-0] DEBUG org.apache.hadoop.ipc.Client - IPC Client (47)     connection to ...
12:03:58.408 [IPC Client (47) connection to xxxxxx from xxxx]         DEBUG org.apache.hadoop.ipc.Client - IPC Client (47) connection to ...
12:03:58.408 [main] DEBUG org.apache.hadoop.ipc.RPC - Call: getListing 1
drwxr-xr-x   - abc supergroup          0 2013-02-21 18:01 /user/xxxx/res
12:03:58.409 [sendParams-0] DEBUG org.apache.hadoop.ipc.Client - IPC Client (47)      connection to xxxxxx/xxxxx from xxxx sending #13
12:03:58.410 [IPC Client (47) connection to xxxxxx/xxxxx from xxxx]     DEBUG org.apache.hadoop.ipc.Client - IPC Client (47) connection to      xxxxxx/xxxxxx from xxxx got value #13
12:03:58.410 [main] DEBUG org.apache.hadoop.ipc.RPC - Call: getListing 1
drwxr-xr-x   - xxxxx supergroup          0 2013-02-21 12:20 /user/xxxxx/rhipeTest
12:03:58.410 [sendParams-0] DEBUG org.apache.hadoop.ipc.Client - IPC Client (47)       connection to xxxxx/xxxx from tenglin sending #14
12:03:58.411 [IPC Client (47) connection to xxxxxx from xxxxx]        DEBUG org.apache.hadoop.ipc.Client - IPC Client (47) connection to        xxxxxx/xxxxxx from xxxxxxx got value #14
12:03:58.411 [main] DEBUG org.apache.hadoop.ipc.RPC - Call: getListing 1
-rw-r--r--   2 xxxxx supergroup       1229 2013-02-21 12:20        /user/xxxx/rhipeTest/ibm.n_1361467245357.dat
drwxr-xr-x   - xxxxx supergroup          0 2013-02-22 11:47 /user/xxxx/test
12:03:58.412 [sendParams-0] DEBUG org.apache.hadoop.ipc.Client - IPC Client (47)        connection to xxxx/xxxxx from tenglin sending #15
12:03:58.413 [IPC Client (47) connection to xxxx from xxxxx]         DEBUG org.apache.hadoop.ipc.Client - IPC Client (47) connection to          xxxxx/xxxxx from xxxxx got value #15
12:03:58.414 [main] DEBUG org.apache.hadoop.ipc.RPC - Call: getListing 2
-rw-r--r--   2 tenglin supergroup       5092 2013-02-22 11:47        /user/xxxxx/test/aa.us_1361551612607.dat
-rw-r--r--   2 tenglin supergroup       5125 2013-02-22 11:47 /user/xxxxx/test/aapl.q_1361551612607.dat
....

0 个答案:

没有答案