Question

我有一堆明文形式的推文，如下所示。我希望仅提取文本部分。

文件中的数据样本 -

Fri Nov 13 20:27:16 +0000 2015 4181010297 rt     we're treating one of you lads to this d'struct denim shirt! simply follow &amp; rt to enter
Fri Nov 13 20:27:16 +0000 2015 2891325562 this album is wonderful, i'm so proud of you, i loved this album, it really is the best.    -273
Fri Nov 13 20:27:19 +0000 2015 2347993701 international break is garbage smh. it's boring and your players get injured
Fri Nov 13 20:27:20 +0000 2015 3168571911 get weather updates from the weather channel. 15:27:19
Fri Nov 13 20:27:20 +0000 2015 2495101558 woah what happened to twitter this update is horrible
Fri Nov 13 20:27:19 +0000 2015 229544082 i've completed the daily quest in paradise island 2!
Fri Nov 13 20:27:17 +0000 2015 309233999 new post: henderson memorial public library
Fri Nov 13 20:27:21 +0000 2015 291806707 who's going to  next week?
Fri Nov 13 20:27:19 +0000 2015 3031745900 why so blue?    @ golden bee

这是我的尝试在预处理阶段 -

for filename in glob.glob('*.txt'):
    with open("plain text - preprocesshurricane.txt",'a') as outfile ,open(filename, 'r') as infile:
        for tweet in infile.readlines():
            temp=tweet.split(' ')
            text=""
            for i in temp:
                x=str(i)
                if x.isalpha() :
                    text += x + ' '
            print(text)

OUTPUT -

Fri Nov rt treating one of you lads to this denim simply follow rt to 
Fri Nov this album is so proud of i loved this it really is the 
Fri Nov international break is garbage boring and your players get 
Fri Nov get weather updates from the weather 
Fri Nov woah what happened to twitter this update is 
Fri Nov completed the daily quest in paradise island 
Fri Nov new henderson memorial public 
Fri Nov going to next 
Fri Nov why so golden

此输出不是所需的输出，因为

1。它不会让我在推文的文本部分中获取数字/数字 2.每一行都以FRI NOV开头。

你能否提出一个更好的方法来实现同样的目标？我对正则表达式不太熟悉，但我认为我们可以使用re.search(r'2015(magic to remove tweetID)/w*',tweet)

Answer 1

在这种情况下，您可以避免使用正则表达式。您提供的文本行在推文文本之前的空格数方面是一致的。只需split()：

def new
   @profile = current_user.profiles.build
end

Answer 2

你可以在没有正则表达式的情况下完成

import glob

for filename in glob.glob('file.txt'):
    with open("plain text - preprocesshurricane.txt",'a') as outfile ,open(filename, 'r') as infile:
        for tweet in infile.readlines():
            temp=tweet.split(' ')
            print('{}'.format(' '.join(temp[7:])))

Answer 3

我提出了比@Rushy Panchal更具体的模式，以避免在推文包含数字时出现问题：.+ \+(\d+ ){3}

使用re.sub功能

>>> import re
>>> with open('your_file.txt','r') as file:
...     data = file.read()
...     print re.sub('.+ \+(\d+ ){3}','',data)

<强>输出

rt     we're treating one of you lads to this d'struct denim shirt! simply follow &amp; rt to enter
this album is wonderful, i'm so proud of you, i loved this album, it really is the best.    -273
international break is garbage smh. it's boring and your players get injured
get weather updates from the weather channel. 15:27:19
woah what happened to twitter this update is horrible
i've completed the daily quest in paradise island 2!
new post: henderson memorial public library
who's going to  next week?
why so blue?    @ golden bee

Answer 4

您正在寻找的模式是.+ \d+：

import re
p = re.compile(".+ \d+")
tweets = p.sub('', data) # data is the original string

模式细分

.匹配任何字符，+匹配1个或更多。因此，.+匹配一个或多个字符。但是，如果我们将其留在此处，我们将删除所有文本。

因此，我们希望以\d+ - \d匹配任何数字来结束模式，因此这将匹配任何连续的数字序列，其中最后一个是推文ID。

如何从python中的文本文件中获取子字符串？

4 个答案: