Question

我需要帮助调整输入内容以匹配输出。我相信我的问题出在我的目标变量上。我收到标题中所述的错误。我尝试了.reshape和.flatten（）。请帮助，并预先感谢

NEnews_train = []
for line in open('/Users/db/Desktop/NE1.txt', 'r'):
    NEnews_train.append(line.strip())



REPLACE_NO_SPACE = re.compile("[.;:!\'?,\"()\[\]]")
REPLACE_WITH_SPACE = re.compile("(<br\s*/><br\s*/>)|(\-)|(\/)")

def preprocess_reviews(reviews):
    reviews = [REPLACE_NO_SPACE.sub("", line.lower()) for line in reviews]
    reviews = [REPLACE_WITH_SPACE.sub(" ", line) for line in reviews]


    return reviews

NE_train_clean = preprocess_reviews(NEnews_train)

from nltk.corpus import stopwords

english_stop_words = stopwords.words('english')
def remove_stop_words(corpus):
    removed_stop_words = []
    for review in corpus:
        removed_stop_words.append(
            ' '.join([word for word in review.split() 
                      if word not in english_stop_words])
        )
    return removed_stop_words

no_stop_words = remove_stop_words(NE_train_clean)



ngram_vectorizer = CountVectorizer(binary=True, ngram_range=(1, 2))
ngram_vectorizer.fit(no_stop_words)
X = ngram_vectorizer.transform(no_stop_words)
X_test = ngram_vectorizer.transform(no_stop_words)

target = [1 if i < 12 else 0 for i in range(25)]

X_train, X_val, y_train, y_val = train_test_split(
    X, target, train_size = 0.75
)

这是错误

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-14-281ec07b46bb> in <module>
      2 
      3 X_train, X_val, y_train, y_val = train_test_split(
----> 4     X, target, train_size = 0.75
      5 )

~/opt/anaconda3/lib/python3.7/site-packages/sklearn/model_selection/_split.py in train_test_split(*arrays, **options)
   2094         raise TypeError("Invalid parameters passed: %s" % str(options))
   2095 
-> 2096     arrays = indexable(*arrays)
   2097 
   2098     n_samples = _num_samples(arrays[0])

~/opt/anaconda3/lib/python3.7/site-packages/sklearn/utils/validation.py in indexable(*iterables)
    228         else:
    229             result.append(np.array(X))
--> 230     check_consistent_length(*result)
    231     return result
    232 

~/opt/anaconda3/lib/python3.7/site-packages/sklearn/utils/validation.py in check_consistent_length(*arrays)
    203     if len(uniques) > 1:
    204         raise ValueError("Found input variables with inconsistent numbers of"
--> 205                          " samples: %r" % [int(l) for l in lengths])
    206 
    207 

ValueError: Found input variables with inconsistent numbers of samples: [24, 25]

我看到人们有相似的错误，但是他们的代码与我的有所不同，所以我在尝试解决时有些困惑

Answer 1

在您的SELECT px1.tbl.value('@name','nvarchar(50)') as TableName ,px2.col.value('@name','nvarchar(50)') as ColName from #testXML px cross apply inputxml.nodes ('/document/table') as px1(tbl) cross apply inputxml.nodes ('/document/table/column') as px2(col)列表中，项目总数为X。但是，在您的24数组中，您采用的是target值（因为25返回了一个range(25)总共25个值（不包括[0, 1, 2, ..., 24]的数组），这就是{{ 1}}出现上述错误，因为25要求train_test_split为真。

解决方案：

train_test_split

如果要从X.shape[0] == target.shape[0]到`25（included）``

开始，请使用以下代码更改上面的代码。

target = [1 if i < 12 else 0 for i in range(25)]

或者，如果您想从1到target = [1 if i < 12 else 0 for i in range(1,26)]，那么

0

找到样本数量不一致的输入变量：[24，25]

1 个答案: