我遇到了一个小错误,但是我无法找到它。我的目的是比较包含这些单词的文本文件。
secondly
pardon
woods
secondly
我编写了脚本以这种方式比较这两个值:
secondly, pardon
secondly, woods
secondly, secondly
pardon, woods
pardon, secondly
woods, secondly
我的代码执行以下操作:
1)如果单词相同则得分为1,否则它是由gensim向量模型计算的得分 2)有一个计数器,当第一个for循环移动到下一个字时,计数器将复位。例如,其次,赦免>其次,伍兹>第二,其次(此时计数为3)
代码
from __future__ import division
import gensim
textfile = 'businessCleanTxtUniqueWords'
model = gensim.models.Word2Vec.load("businessSG")
count = 0 # keep track of counter
score = 0
avgScore = 0
SentenceScore = 0
externalCount = 0
totalAverageScore = 0
with open(textfile, 'r+') as f1:
words_list = f1.readlines()
for each_word in words_list:
word = each_word.strip()
for each_word2 in words_list[words_list.index(each_word) + 1:]:
count = count + 1
try:
word2 = each_word2.strip()
print(word, word2)
# if words are the same
if (word == word2):
score = 1
else:
score = model.similarity(word,word2) # when words are not the same
# if word is not in vector model
except KeyError:
score = 0
# to keep track of the score
SentenceScore=SentenceScore + score
print("the score is: " + str(score))
print("the count is: " + str(count))
# average score
avgScore = round(SentenceScore / count,5)
print("the avg score: " + str(SentenceScore) + '/' + str(count) + '=' + str(avgScore))
# reset counter and sentence score
count = 0
SentenceScore = 0
错误消息:
Traceback (most recent call last):
File "C:/Users/User/Desktop/Complete2/Complete/TrainedTedModel/LatestJR.py", line 41, in <module>
avgScore = round(SentenceScore / count,5)
ZeroDivisionError: division by zero
('secondly', 'pardon')
the score is: 0.180233083443
the count is: 1
('secondly', 'woods')
the score is: 0.181432347816
the count is: 2
('secondly', 'secondly')
the score is: 1
the count is: 3
the avg score: 1.36166543126/3=0.45389
('pardon', 'woods')
the score is: 0.405021005657
the count is: 1
('pardon', 'secondly')
the score is: 0.180233083443
the count is: 2
the avg score: 0.5852540891/2=0.29263
('woods', 'secondly')
the score is: 0.181432347816
the count is: 1
the avg score: 0.181432347816/1=0.18143
我已经包含了#34; from __future__ import division
&#34;对于分裂,但它似乎没有解决它
我的文件可在以下链接中找到:
Gensim模特:
TEXTFILE:
谢谢。
答案 0 :(得分:1)
这是因为第一个for
循环已到达最后一个字,第二个for
循环将不会执行,因此count
等于零(在上一次迭代中重置为零) )。只需更改第一个for
循环即可忽略最后一个单词(因为没有必要):
for each_word in words_list[:-1]:
答案 1 :(得分:1)
出错的行直接在错误消息中说明:
Traceback (most recent call last):
File "C:/Users/User/Desktop/Complete2/Complete/TrainedTedModel/LatestJR.py", line 41, in <module>
avgScore = round(SentenceScore / count,5)
ZeroDivisionError: division by zero
所以我假设SentenceScore / count
是有问题的分区,所以很明显count
为0,我建议你在该行之前添加如下内容:
print("SentenceScore is",SentenceScore, "and count is",count)
所以你可以自己看看这个,现在是内循环:
for words_list中的each_word2 [words_list.index(each_word)+ 1:]: count = count + 1
是唯一添加到count和count的东西,在外循环的每次迭代结束时重置为零,这意味着内部循环在某个时刻根本不运行,这意味着{{1}是一个空序列。如果words_list[words_list.index(each_word) + 1:]
是each_word
中的最后一个单词,则会发生这种情况。