awk过滤出邮件/规则并显示合并邮件的数量

时间:2018-09-24 13:35:04

标签: shell awk filter line rules

对于我工作的公司,我想在(实际上:2)日志文件中过滤掉某些消息。

这些消息仅供参考,在解决错误/故障时并不是特别有用。

经过长时间的讨论(我也发表了类似的问题,但对于Windows及其PS / BS(某些“牛粪”;)))

我认为AWK适合该工作,并且我编写了一个Shell脚本。 但是,它没有运行(预期)。 有人可以帮我“填补空白”吗?

#!/bin/bash

## URL that could have been the answer (but not quite)    https://stackoverflow.com/questions/10842118/explain-this-duplicate-line-removing-order-retaining-one-line-awk-command



###To sort by what you WANT to see:
##e.g awk '/term to search/' dpkg.log

#if 
#    $var_show awk '/installed/' syslog/dpkg.log
#    then
#    printf('$var_show')
#fi







##Show what DONT want to see.
if
    #$var_notshow awk /'what not to display'/ syslog/dpkg.log
    $var_notshow awk /'Status Installed'/ dpkg.log
then
wc -1 > $var_notshow 
#echo number of merged messages (of the same content): xxx merged messages #< is the amount 
echo Messages of Status installed: $var_notshow were merged
fi 
###!!Show the amount of rules (when the same rule/logged event) that were merged
## E.g. (multiple lines which state: "Status Installed: xxxxxxxxxxxxx" ) and display it as: "Messages of Status Installed: xxxx were merged. Totalling: # of messages (of Status Installed)" were merged. 

### Finally, save it in a different file.
#Like: ?? how to do that?

因此,基本上,我有两种方法可以执行此操作:过滤所需的内容或不需要的内容。开始过滤掉我不想要的消息可能会更好/更干净。

是的,作为概念证明,我在测试机中使用了标准日志文件。 我可以将其转换为公司的特定信息...

摘录自日志文件:

 11:56:31 status half-configured grep:amd64 3.1-2
 11:56:32 status installed grep:amd64 3.1-2
 11:56:32 configure debconf:all 1.5.66 <none>
 11:56:32 status unpacked debconf:all 1.5.66
 11:56:32 status unpacked debconf:all 1.5.66
 11:56:32 status unpacked debconf:all 1.5.66
 11:56:32 status half-configured debconf:all 1.5.66
 11:56:32 status installed debconf:all 1.5.66
 11:56:32 configure gzip:amd64 1.6-5ubuntu1 <none>
 11:56:33 status half-configured util-linux:amd64 2.31.1-0.
 11:56:34 status installed util-linux:amd64 2.31.1-0.4ubuntu3
 11:56:34 configure libpam-modules-bin:amd64 1.1.8-3.6ubuntu2 <none>
 11:56:34 status unpacked libpam-modules-bin:amd64 1.1.8-3.6ubuntu2
 11:56:34 status half-configured libpam-modules-bin:amd64 1.1.8-3.6ubuntu2
 11:56:34 status installed libpam-modules-bin:amd64 1.1.8-3.6ubuntu2
 11:56:34 configure mount:amd64 2.31.1-0.4ubuntu3 <none>
 11:56:34 status unpacked mount:amd64 2.31.1-0.4ubuntu3
 11:56:34 status half-configured mount:amd64 2.31.1-0.4ubuntu3
 11:56:34 status installed mount:amd64 2.31.1-0.4ubuntu3
 11:56:34 configure procps:amd64 2:3.3.12-3ubuntu1 <none>
 11:56:34 status unpacked procps:amd64 2:3.3.12-3ubuntu1
 11:56:34 status unpacked procps:amd64 2:3.3.12-3ubuntu1
 11:56:34 status unpacked procps:amd64 2:3.3.12-3ubuntu1

先谢谢您了:)

托马斯

1 个答案:

答案 0 :(得分:0)

显示所有有趣的行:

grep interesting file

显示除无趣的行以外的所有内容:

grep -v "Status uninteresting" file

用awk计数:

awk '/uninteresting/{n++}END{print "uninteresting messages: "n}'

将命令输出重定向到新文件中

grep interesting file | grep -v uninteresting > newFile

或附加到newFile:

grep interesting file | grep -v uninteresting >> newFile

一次完成所有操作:

awk '/uninteresting/{u++;next}/interesting/{print}END{print "uninteresting lines: "u}'
this is interesting
uninteresting lines: 1