如何评估rasa nlu模型

时间:2019-04-19 05:08:27

标签: python-3.x deep-learning spacy rasa-nlu

在kaggle笔记本中使用run_evaluation模块评估rasa nlu模型时出现错误,如下所示:

TypeError: classification_report() got an unexpected keyword argument 'output_dict'



from rasa_nlu.evaluate import run_evaluation

run_evaluation("nlu.md", model_directory)
expected output:


INFO:rasa_nlu.evaluate:There were some nlu intent classification errors. Use `--verbose` to show them in the log.
INFO:rasa_nlu.evaluate:Model prediction errors saved to errors.json.
INFO:rasa_nlu.evaluate:Confusion matrix, without normalization: 
[[10  1  0  0  0  0  0]
 [ 0 13  0  0  0  0  0]
 [ 0  0 10  0  0  0  0]
 [ 0  0  0  5  0  0  0]
 [ 0  0  0  0  6  0  0]
 [ 0  0  0  0  0 15  0]
 [ 0  0  0  0  0  0 25]]

2 个答案:

答案 0 :(得分:0)

似乎与您使用的scikit-learn版本(https://github.com/RasaHQ/rasa/issues/1742)有关。请尝试安装scikit-learn 0.20.2,或者通过执行1.x更好地升级到Rasa pip install rasa

答案 1 :(得分:0)

评估函数现在称为测试。试试这个:

从rasa_nlu.test导入run_evaluation

参考来自: https://forum.rasa.com/t/run-evaluation-function-can-not-be-imported/9258

相关问题