从纯文本日志中读取数据

时间:2018-10-08 16:45:25

标签: mysql logging sqlite nosql static-analysis

我不确定该问题是否在StackOverflow的“范围内”,如果不是,在删除问题之前,我希望您能提出一些建议。

所以...我的问题与从原始信息中提取有用数据的最佳方法有关,如何以及在哪里询问我的需求以及我应该支付的费用。

我有一个电话信息系统的继承部分,它将其日志写入两个平面文件中。

第一个包含基本呼叫信息,每个呼叫一行和唯一的呼叫ID(与“呼叫者ID”不同!) 第二个文件将呼叫ID与该呼叫期间发生的情况的更多信息联系起来。

我真的很想提取信息,例如: 什么是最受欢迎的来电者区域?一天中的时间?菜单中的项目?人们听最多的是什么,或者跳过或挂断电话?手机占百分之几?

所有信息都在那里,但是我不知道如何提取它,也不知道自己要具备的技能。

所以我的问题是真的:现在呢?现在实际上也可以将日志写入dynamoDB或sqlite3。 每小时人数?还是其他一些网络工作者网站?我应该支付什么?这种数据处理甚至被称为什么?

这是详细信息:

log.txt

日期和时间,呼叫者,持续时间,位置,县,Outcode,Lat,长

2018-10-03 11:09:23,0208605,00:02:00,London,1538561363.526,Westminster,WC2N,51.5073219,-0.1276474
2018-10-03 13:07:02,0791439,00:07:12,UKmobile,1538568422.566,,,,
2018-10-05 04:12:45,0791439,00:02:53,UKmobile,1538709165.1208,,,,

log-detail.txt

UniqueID,Date Time,Action,Menu,track name,"current track 
number",total tracks,control,current time,total duration
1538561363.526,2018-10-03 11:10:31,m,menu2-demo1,,2,,0,00:0:0,00:0:0
1538561363.526,2018-10-03 11:10:41,m,menu2-demo1/menu1-demo1-weekly,,1,,0,00:0:0,00:0:0
1538561363.526,2018-10-03 11:10:58,t,menu2-demo1/menu1-demo1-weekly,1-00000001-K-T-N-1838,1,40,0,00:0:0,00:0:0
1538561363.526,2018-10-03 11:11:10,c,menu2-demo1/menu1-demo1-weekly,quick_1-00000001-K-T-N-1838,1,40,2,00:00:12,00:01:04
1538561363.526,2018-10-03 11:11:24,h,menu2-demo1/menu1-demo1-weekly,3-00000003-K-T-N-1838,3,40,9,00:00:02,00:02:05

1538568422.566,2018-10-03 13:08:58,m,menu2-demo1,,2,0,0,00:0:0,00:0:0
1538568422.566,2018-10-03 13:09:15,m,menu2-demo1/menu3-Eye-Opener,,3,0,0,00:0:0,00:0:0
1538568422.566,2018-10-03 13:09:23,t,menu2-demo1/menu3-Eye-Opener,1-eye-opener-40-Summer-2018,1,1,0,00:0:0,00:0:0
1538568422.566,2018-10-03 13:13:39,c,menu2-demo1/menu3-Eye-Opener,1-eye-opener-40-Summer-2018,1,1,4,00:04:16,00:19:04
1538568422.566,2018-10-03 13:14:15,h,menu2-demo1/menu3-Eye-Opener,1-eye-opener-40-Summer-2018,1,1,4,00:04:16,00:19:04

1538709165.1208,2018-10-05 04:14:01,m,menu2-demo1,,2,0,0,00:0:0,00:0:0
1538709165.1208,2018-10-05 04:14:08,m,menu2-demo1/menu1-demo1-weekly,,1,0,0,00:0:0,00:0:0
1538709165.1208,2018-10-05 04:14:18,t,menu2-demo1/menu1-demo1-weekly,1-00000001-K-T-N-1838,1,40,0,00:0:0,00:0:0
1538709165.1208,2018-10-05 04:15:22,t,menu2-demo1/menu1-demo1-weekly,2-00000002-K-T-N-1838,2,40,0,00:0:0,00:0:0
1538709165.1208,2018-10-05 04:15:38,h,menu2-demo1/menu1-demo1-weekly,2-00000002-K-T-N-1838,2,40,0,00:0:0,00:0:0

第二个详细信息日志中“操作”列的键:

m = menu: a user selected a menu level
t = track: a user selected a track
f = feature: a user selected a special star action, like connecting to helpline (not in this example)
c = control: while listening to a track, a user carried out an action like help, skip, pause etc. Reminder below:

控制列的键:

1 and 3: back and forth 30 seconds
4 and 6: back and forth 3 minutes
7 and 9: back and forth a whole track
5: pause
#: help
0: n/a (just a blank for where a menu level was entered) 

0 个答案:

没有答案