Question

这是我关于weka用法的第二篇帖子（第一篇是发布here）。我成功地使用TextDirectoryLoader为Weka提供了培训和样本测试数据。效果很好。现在我想将其移至生产中，因此要从mysql表中检索要分类的数据。我就是这样做的：

    TextDirectoryLoader loader = new TextDirectoryLoader();
    loader.setDirectory(new File("c:/Users/Yehia A.Salam/Desktop/dd/training-data"));
    Instances dataRaw = loader.getDataSet();

    StringToWordVector filter = new StringToWordVector();
    filter.setInputFormat(dataRaw);
    Instances dataTraining = Filter.useFilter(dataRaw, filter);

    // Create test data instances[this works, but the sample data now needs to come frm the db instead, see below]
    //loader.setDirectory(new File("c:/Users/Yehia A.Salam/Desktop/dd/test-data"));
    //dataRaw = loader.getDataSet();
    //Instances dataTest = Filter.useFilter(dataRaw, filter);

    InstanceQuery query = new InstanceQuery();
    query.setUsername("myusername");
    query.setPassword("mypassword");
    String sql = "SELECT d.desc FROM deals d WHERE d.j48 = 1";
    query.setQuery(sql);
    Instances dataTest = Filter.useFilter(query.retrieveInstances(), filter);

    // Classify
    J48 model = new J48();
    model.buildClassifier(dataTraining);

    for (int i = 0; i < dataTest.numInstances(); i++) {
             dataTest.instance(i).setClassMissing();
             double cls = model.classifyInstance(dataTest.instance(i));
             dataTest.instance(i).setClassValue(cls);
             System.out.println(cls + " -> " + dataTest.instance(i).classAttribute().value((int) cls));

    }

不幸的是，这不起作用，weka意外停止了这一行：

Instances dataTest = Filter.useFilter(query.retrieveInstances(), filter);

所以我想我的问题是如何改变这部分

// Create test data instances[this works, but the sample data now needs to come frm the db instead, see below]
//loader.setDirectory(new File("c:/Users/Yehia A.Salam/Desktop/dd/test-data"));
//dataRaw = loader.getDataSet();
//Instances dataTest = Filter.useFilter(dataRaw, filter);

到基于sql的数据

InstanceQuery query = new InstanceQuery();
query.setUsername("myusername");
query.setPassword("mypassword");
String sql = "SELECT d.desc FROM deals d WHERE d.j48 = 1";
query.setQuery(sql);
Instances dataTest = Filter.useFilter(query.retrieveInstances(), filter);

请注意，数据库连接没有问题，我实际获得了正确的实例数。

非常感谢您的帮助。

Answer 1

您的代码使用基于TextDirectoryLoader的Arff Files from Text Collections类。根据他们的帮助文件

"Loads all text files in a directory and 
 uses the subdirectory names as class labels. 
 The content of the text files will be stored in a String attribute, 
 the filename can be stored as well."

请参阅以下code

 double[] newInst = new double[2];
 newInst[0] = (double)data.attribute(0).addStringValue(files[i]);
 ....
 newInst[1] = (double)data.attribute(1).addStringValue(txtStr.toString());
 data.add(new Instance(1.0, newInst));

如您所见，此代码需要2个属性值来添加数据集。但是你的sql只提供了一个属性。

 String sql = "SELECT d.desc FROM deals d WHERE d.j48 = 1";

这可能是您在newInst 1代码中遇到问题“（java.lang.ArrayIndexOutOfBoundsException）”的原因。 Weka找不到第二个属性。

Answer 2

我自己是一个初学者，但为了防止它有用，你知道有一个DatabaseLoader类和一个DatabaseConverter接口吗？

来自MySql数据库的Weka训练数据

2 个答案: