用于过滤多维度日志的Web或控制台UI?

时间:2016-02-25 02:49:04

标签: user-interface web log-analysis

我正在编写一个工具来帮助分析小型日志文件(例如1-2 MB,在极少数情况下最多50 MB)。

日志文件来自文件同步应用程序,包含各种不同的日志:

2016-02-22 21:18:03,872 +0200 INFO pid=670 4664029184:PerfReporter    perf_reporter.pyo:71 Current Stats: sync_bo=0, dio=266945, blacklist_len=0, uptime=1601770, pc=60, sync_x=0, sync_y=0, prs=78368, sync_percent=0, corpus=8819, c0=1510, pvm=3095812
2016-02-22 21:18:03,874 +0200 INFO pid=670 4664029184:PerfReporter    sync_http_client.pyo:237 Opening direct connection to csi.gstatic.com:443.
2016-02-22 21:19:13,185 +0200 INFO pid=670 4650881024:SyncClientImpressionsThread impression_logger.pyo:278 Heartbeat was added.

2015-06-23 12:15:29,860 +0300 INFO pid=33914 4634906624:Worker-2        snapshot_sqlite.pyo:143 Adding local entry inode=57033344, filename=None
2015-06-23 12:15:29,861 +0300 INFO pid=33914 4634906624:Worker-2        snapshot_sqlite.pyo:171 Adding cloud entry resource_id=file:0B_JGPr4BzMr4dmdCbFBibms5WFk, filename=None
2015-06-23 12:15:29,862 +0300 INFO pid=33914 4634906624:Worker-2        snapshot_sqlite.pyo:253 Updating cloud entry doc_id=0B_JGPr4BzMr4dmdCbFBibms5WFk, filename=~$Foo Bar.xlsx

2015-06-23 12:15:30,247 +0300 INFO pid=33914 4651732992:Batcher         batcher.pyo:849 Batcher Stats = file_count = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=_FSChangeActionType(Action.CREATE), batch=False, successful=True): 1}), byte_count = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=
_FSChangeActionType(Action.CREATE), batch=False, successful=True): 165}), batch_operation_count = Counter(), process_seconds = Counter({_COUNT_KEY(direction=_DownloadDirectionType(Direction.DOWNLOAD), action=_FSChangeActionType(Action.CREATE), batch=False, successful=True): 0.6173379421234131}), duration seconds = 1 (start_time = 1435050929, end_time = 143505093
0)

我将解析出任何键值对,以及几个关键属性(例如inode number,filename,doc_id)

然后我想要一个UI(控制台或Web UI),它允许您按各种方式进行过滤,并显示完整的日志:

  • 按时间范围过滤
  • 按inode编号,文件名,事件类型等进行过滤

是否存在允许沿多个维度轻松过滤的现有UI元素/工具包/框架?

例如,您可以选择inode编号和事件类型,并查看该组合随时间变化的完整历史记录?

可能与Splunk / Kibana和同类产品相似,但可作为独立组件使用? (控制台或网络)

1 个答案:

答案 0 :(得分:0)

使用MASSALYZER,你可以在控制台中完成。如果您需要帮助,请问我!