从Python中的字符串中删除除字母数字字符之外的所有内容

时间:2009-08-14 08:54:47

标签: python string

使用Python从字符串中删除所有非字母数字字符的最佳方法是什么?

PHP variant of this question中提出的解决方案可能会进行一些微小的调整,但对我来说似乎不太“pythonic”。

为了记录,我不仅要删除句点和逗号(以及其他标点符号),还要删除引号,括号等。

12 个答案:

答案 0 :(得分:282)

我只是出于好奇而计算了一些功能。在这些测试中,我将从字符串string.printable中删除非字母数字字符(内置string模块的一部分)。

$ python -m timeit -s \
     "import string" \
     "''.join(ch for ch in string.printable if ch.isalnum())" 
10000 loops, best of 3: 57.6 usec per loop

$ python -m timeit -s \
    "import string" \
    "filter(str.isalnum, string.printable)"                 
10000 loops, best of 3: 37.9 usec per loop

$ python -m timeit -s \
    "import re, string" \
    "re.sub('[\W_]', '', string.printable)"
10000 loops, best of 3: 27.5 usec per loop

$ python -m timeit -s \
    "import re, string" \
    "re.sub('[\W_]+', '', string.printable)"                
100000 loops, best of 3: 15 usec per loop

$ python -m timeit -s \
    "import re, string; pattern = re.compile('[\W_]+')" \
    "pattern.sub('', string.printable)" 
100000 loops, best of 3: 11.2 usec per loop

答案 1 :(得分:215)

拯救的正则表达式:

import re
re.sub(r'\W+', '', your_string)
  

按Python定义'\W == [^a-zA-Z0-9_],排除所有numbersletters_

答案 2 :(得分:67)

使用 str.translate()方法。

假设你经常这样做:

(1)一次,创建一个包含您要删除的所有字符的字符串:

delchars = ''.join(c for c in map(chr, range(256)) if not c.isalnum())

(2)每当你想要一个字符串:

scrunched = s.translate(None, delchars)

设置成本可能与re.compile相比有利;边际成本低得多:

C:\junk>\python26\python -mtimeit -s"import string;d=''.join(c for c in map(chr,range(256)) if not c.isalnum());s=string.printable" "s.translate(None,d)"
100000 loops, best of 3: 2.04 usec per loop

C:\junk>\python26\python -mtimeit -s"import re,string;s=string.printable;r=re.compile(r'[\W_]+')" "r.sub('',s)"
100000 loops, best of 3: 7.34 usec per loop

注意:使用string.printable作为基准数据会使模式'[\ W _] +'具有不公平的优势;所有非字母数字字符都在一堆...在典型的数据中,有不止一个替换要做:

C:\junk>\python26\python -c "import string; s = string.printable; print len(s),repr(s)"
100 '0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ!"#$%&\'()*+,-./:;=>?@[\\]^_`{|}~ \t\n\r\x0b\x0c'

如果你给re.sub做更多的工作,会发生什么:

C:\junk>\python26\python -mtimeit -s"d=''.join(c for c in map(chr,range(256)) if not c.isalnum());s='foo-'*25" "s.translate(None,d)"
1000000 loops, best of 3: 1.97 usec per loop

C:\junk>\python26\python -mtimeit -s"import re;s='foo-'*25;r=re.compile(r'[\W_]+')" "r.sub('',s)"
10000 loops, best of 3: 26.4 usec per loop

答案 3 :(得分:36)

你可以尝试:

print ''.join(ch for ch in some_string if ch.isalnum())

答案 4 :(得分:13)

>>> import re
>>> string = "Kl13@£$%[};'\""
>>> pattern = re.compile('\W')
>>> string = re.sub(pattern, '', string)
>>> print string
Kl13

答案 5 :(得分:12)

怎么样:

def ExtractAlphanumeric(InputString):
    from string import ascii_letters, digits
    return "".join([ch for ch in InputString if ch in (ascii_letters + digits)])

这可以通过使用列表推导来生成InputString中的字符列表,如果它们存在于合并的ascii_lettersdigits字符串中。然后它将列表连接成一个字符串。

答案 6 :(得分:3)

作为其他答案的衍生产品,我提供了一种非常简单灵活的方法来定义一组您想要限制字符串内容的字符。在这种情况下,我允许使用字母数字PLUS破折号和下划线。只需根据您的使用情况添加或删除PERMITTED_CHARS中的字符。

PERMITTED_CHARS = "0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ_-" 
someString = "".join(c for c in someString if c in PERMITTED_CHARS)

答案 7 :(得分:3)

for char in my_string:
    if not char.isalnum():
        my_string = my_string.replace(char,"")

答案 8 :(得分:1)

sent = "".join(e for e in sent if e.isalpha())

答案 9 :(得分:0)

使用ASCII可打印字符的随机字符串计时:

{
    $facet: 
    {
        "results": 
        [
            {
                "$skip": 
                    start
            },
            {
                "$limit": 
                    finish
            },
        ],
        "total": 
        [
            {
                "$count": 
                    "total" 
            },
        ]
    }
}

结果(Python 3.7):

from inspect import getsource
from random import sample
import re
from string import printable
from timeit import timeit

pattern_single = re.compile(r'[\W]')
pattern_repeat = re.compile(r'[\W]+')
translation_tb = str.maketrans('', '', ''.join(c for c in map(chr, range(256)) if not c.isalnum()))


def generate_test_string(length):
    return ''.join(sample(printable, length))


def main():
    for i in range(0, 60, 10):
        for test in [
            lambda: ''.join(c for c in generate_test_string(i) if c.isalnum()),
            lambda: ''.join(filter(str.isalnum, generate_test_string(i))),
            lambda: re.sub(r'[\W]', '', generate_test_string(i)),
            lambda: re.sub(r'[\W]+', '', generate_test_string(i)),
            lambda: pattern_single.sub('', generate_test_string(i)),
            lambda: pattern_repeat.sub('', generate_test_string(i)),
            lambda: generate_test_string(i).translate(translation_tb),

        ]:
            print(timeit(test), i, getsource(test).lstrip('            lambda: ').rstrip(',\n'), sep='\t')


if __name__ == '__main__':
    main()

Time Length Code 6.3716264850008880 00 ''.join(c for c in generate_test_string(i) if c.isalnum()) 5.7285426190064750 00 ''.join(filter(str.isalnum, generate_test_string(i))) 8.1875841680011940 00 re.sub(r'[\W]', '', generate_test_string(i)) 8.0002205439959650 00 re.sub(r'[\W]+', '', generate_test_string(i)) 5.5290945199958510 00 pattern_single.sub('', generate_test_string(i)) 5.4417179649972240 00 pattern_repeat.sub('', generate_test_string(i)) 4.6772285089973590 00 generate_test_string(i).translate(translation_tb) 23.574712151996210 10 ''.join(c for c in generate_test_string(i) if c.isalnum()) 22.829975890002970 10 ''.join(filter(str.isalnum, generate_test_string(i))) 27.210196289997840 10 re.sub(r'[\W]', '', generate_test_string(i)) 27.203713296003116 10 re.sub(r'[\W]+', '', generate_test_string(i)) 24.008979928999906 10 pattern_single.sub('', generate_test_string(i)) 23.945240008994006 10 pattern_repeat.sub('', generate_test_string(i)) 21.830899796994345 10 generate_test_string(i).translate(translation_tb) 38.731336012999236 20 ''.join(c for c in generate_test_string(i) if c.isalnum()) 37.942474347000825 20 ''.join(filter(str.isalnum, generate_test_string(i))) 42.169366310001350 20 re.sub(r'[\W]', '', generate_test_string(i)) 41.933375883003464 20 re.sub(r'[\W]+', '', generate_test_string(i)) 38.899814646996674 20 pattern_single.sub('', generate_test_string(i)) 38.636144253003295 20 pattern_repeat.sub('', generate_test_string(i)) 36.201238164998360 20 generate_test_string(i).translate(translation_tb) 49.377356811004574 30 ''.join(c for c in generate_test_string(i) if c.isalnum()) 48.408927293996385 30 ''.join(filter(str.isalnum, generate_test_string(i))) 53.901889764994850 30 re.sub(r'[\W]', '', generate_test_string(i)) 52.130339455994545 30 re.sub(r'[\W]+', '', generate_test_string(i)) 50.061149017004940 30 pattern_single.sub('', generate_test_string(i)) 49.366573111998150 30 pattern_repeat.sub('', generate_test_string(i)) 46.649754120997386 30 generate_test_string(i).translate(translation_tb) 63.107938601999194 40 ''.join(c for c in generate_test_string(i) if c.isalnum()) 65.116287978999030 40 ''.join(filter(str.isalnum, generate_test_string(i))) 71.477421126997800 40 re.sub(r'[\W]', '', generate_test_string(i)) 66.027950693998720 40 re.sub(r'[\W]+', '', generate_test_string(i)) 63.315361931003280 40 pattern_single.sub('', generate_test_string(i)) 62.342320287003530 40 pattern_repeat.sub('', generate_test_string(i)) 58.249303059004890 40 generate_test_string(i).translate(translation_tb) 73.810345625002810 50 ''.join(c for c in generate_test_string(i) if c.isalnum()) 72.593953348005020 50 ''.join(filter(str.isalnum, generate_test_string(i))) 76.048324580995540 50 re.sub(r'[\W]', '', generate_test_string(i)) 75.106637657001560 50 re.sub(r'[\W]+', '', generate_test_string(i)) 74.681338128997600 50 pattern_single.sub('', generate_test_string(i)) 72.430461594005460 50 pattern_repeat.sub('', generate_test_string(i)) 69.394243567003290 50 generate_test_string(i).translate(translation_tb) str.maketrans最快,但包含所有非ASCII字符。 str.translatere.compile较慢,但比pattern.sub''.join快。

答案 10 :(得分:0)

对于简单的单行(Python 3.0):

''.join(filter( lambda x: x in '0123456789abcdefghijklmnopqrstuvwxyz', the_string_you_want_stripped ))

对于 Python < 3.0:

filter( lambda x: x in '0123456789abcdefghijklmnopqrstuvwxyz', the_string_you_want_stripped )

注意:如果需要,您可以将其他字符添加到允许的字符列表中(例如'0123456789abcdefghijklmnopqrstuvwxyz.,_')。

答案 11 :(得分:-1)

如果我正确理解,最简单的方法是使用正则表达式,因为它为您提供了很大的灵活性,但是另一种简单的方法是用于循环跟踪的是带有示例的代码,我也计算了单词的出现次数并存储在字典中。

s = """An... essay is, generally, a piece of writing that gives the author's own 
argument — but the definition is vague, 
overlapping with those of a paper, an article, a pamphlet, and a short story. Essays 
have traditionally been 
sub-classified as formal and informal. Formal essays are characterized by "serious 
purpose, dignity, logical 
organization, length," whereas the informal essay is characterized by "the personal 
element (self-revelation, 
individual tastes and experiences, confidential manner), humor, graceful style, 
rambling structure, unconventionality 
or novelty of theme," etc.[1]"""

d = {}      # creating empty dic      
words = s.split() # spliting string and stroing in list
for word in words:
    new_word = ''
    for c in word:
        if c.isalnum(): # checking if indiviual chr is alphanumeric or not
            new_word = new_word + c
    print(new_word, end=' ')
    # if new_word not in d:
    #     d[new_word] = 1
    # else:
    #     d[new_word] = d[new_word] +1
print(d)

如果此答案有用,请给它打分!