使用Soundex,python替换单词

时间:2014-02-07 12:56:45

标签: python nltk soundex metaphone

我有一个句子列表,基本上我的目的是以“opp,nr,off,abv,behnd”的形式用正确的拼写“对面,近处,上面,后面”替换介词的所有差异出现等等上。单词的soundex代码是相同的,所以我需要构建一个表达式逐字迭代这个列表,如果soundex是相同的,用正确的拼写替换它。

一个例子 -         [杰克站在树上','         “他们是他计划的一切”,     “只要反击柜台”,     '去加油站']

所以我需要用正确的完整形式替换nr,abv,opp和twrds这些单词。朝向和twrds的soundex代码是相同的,因此应该被替换 我需要迭代这个列表..
这是soundex算法:

import string

allChar = string.uppercase + string.lowercase
charToSoundex = string.maketrans(allChar, "91239129922455912623919292" * 2)

def soundex(source):
    "convert string to Soundex equivalent"

    # Soundex requirements:
    # source string must be at least 1 character
    # and must consist entirely of letters
    if (not source) or (not source.isalpha()):
    return "0000"

    # Soundex algorithm:
    # 1. make first character uppercase
    # 2. translate all other characters to Soundex digits
    digits = source[0].upper() + source[1:].translate(charToSoundex)

    # 3. remove consecutive duplicates
    digits2 = digits[0]
    for d in digits[1:]:
        if digits2[-1] != d:
           digits2 += d

    # 4. remove all "9"s
    # 5. pad end with "0"s to 4 characters
    return (digits2.replace('9', '') + '000')[:4]

if __name__ == '__main__':
   import sys
   if sys.argv[1:]:
      print soundex(sys.argv[1])
   else:
    from timeit import Timer
    names = ('Woo', 'Pilgrim', 'Flingjingwaller')
    for name in names:
        statement = "soundex('%s')" % name
        t = Timer(statement, "from __main__ import soundex")
        print name.ljust(15), soundex(name), min(t.repeat())

我是新手,所以万一你可以提出另一种方法,我们将不胜感激。谢谢。

1 个答案:

答案 0 :(得分:0)

我将使用附魔模块:

import enchant
d = enchant.Dict("en_US")

phrase = ['Jack was standing nr the tree' ,
'they were abv everything he planned' ,
'Just stand opp the counter' ,
'Go twrds the gas station']

output = []
for section in phrase:
    sect = ''
    for word in section.split():
        if d.check(word):
            sect += word + ' '
        else:
            for correct_word in d.suggest(word):
                if soundex(correct_word) == soundex(word):
                    sect +=  correct_word + ' '
    output.append(sect[:-1])