scikit cosine_similarity vs pairwise_distances

时间:2016-02-09 00:06:34

标签: python nlp scikit-learn

Scikit-learn的sklearn.metrics.pairwise.cosine_similarity和sklearn.metrics.pairwise.pairwise_distances(.. metric =“cosine”)有什么区别?

from sklearn.feature_extraction.text import TfidfVectorizer

documents = (
    "Macbook Pro 15' Silver Gray with Nvidia GPU",
    "Macbook GPU"    
)

tfidf_vectorizer = TfidfVectorizer()
tfidf_matrix = tfidf_vectorizer.fit_transform(documents)

from sklearn.metrics.pairwise import cosine_similarity
print(cosine_similarity(tfidf_matrix[0:1], tfidf_matrix)[0,1])

0.37997836

from sklearn.metrics.pairwise import pairwise_distances
print(pairwise_distances(tfidf_matrix[0:1], tfidf_matrix, metric='cosine')[0,1])

0.62002164

为什么这些不同?

2 个答案:

答案 0 :(得分:14)

来自源代码documentation

Cosine distance is defined as 1.0 minus the cosine similarity.

所以你的结果很有意义。

答案 1 :(得分:0)

成对距离提供两个阵列之间的距离。成对距离越大,则表示相似度越低。而余弦相似度是1pairwise_distance,则余弦相似度越高,表示两个阵列之间的相似度越高。