Stanford-NLP kbp语料库训练

时间:2019-03-05 01:20:38

标签: machine-learning nlp stanford-nlp corpus

我正在尝试学习如何创建和训练用于抽取关系的语料库。我了解到我需要conll格式的语料库。但是,我不知道该如何训练语料库。

这是我必须以conll格式打印示例文本的一些代码。我不确定如何用适当的更改来修改此文件,然后进行培训。

Properties props = new Properties();
    props.setProperty("annotators", "tokenize,ssplit,pos,lemma,ner,parse,depparse,coref,natlog,sentiment,kbp,quote");
    props.setProperty("coref.algorithm", "neural");

    StanfordCoreNLP pipeline = new StanfordCoreNLP(props);

    String text = "The modern definition of artificial intelligence (or AI) is \"the study and design of intelligent agents\" where an intelligent agent is a system that perceives its environment and takes actions which maximizes its chances of success. " + 

            "John McCarthy, who coined the term in 1956, defines it as \"the science and engineering of making intelligent machines. " +

            "Other names for the field have been proposed, such as computational intelligence, synthetic intelligence or computational rationality. " + 

            "The term artificial intelligence is also used to describe a property of machines or programs: the intelligence that the system demonstrates. " + 

            "AI research uses tools and insights from many fields, including computer science, psychology, philosophy, neuroscience, cognitive science, linguistics, operations research, economics, control theory, probability, optimization and logic. " + 

            "AI research also overlaps with tasks such as robotics, control systems, scheduling, data mining, logistics, speech recognition, facial recognition and many others. " + 

            "Computational intelligence Computational intelligence involves iterative development or learning (e.g., parameter tuning in connectionist systems). " + 

            "Learning is based on empirical data and is associated with non-symbolic AI, scruffy AI and soft computing. " + 

            "Subjects in computational intelligence as defined by IEEE Computational Intelligence Society mainly include: Neural networks: trainable systems with very strong pattern recognition capabilities. " + 

            "Fuzzy systems: techniques for reasoning under uncertainty, have been widely used in modern industrial and consumer product control systems; capable of working with concepts such as 'hot', 'cold', 'warm' and 'boiling'. " + 

            "Evolutionary computation: applies biologically inspired concepts such as populations, mutation and survival of the fittest to generate increasingly better solutions to the problem. " + 

            "These methods most notably divide into evolutionary algorithms (e.g., genetic algorithms) and swarm intelligence (e.g., ant algorithms). " + 

            "With hybrid intelligent systems, attempts are made to combine these two groups. " + 

            "Expert inference rules can be generated through neural network or production rules from statistical learning such as in ACT-R or CLARION. " + 

            "It is thought that the human brain uses multiple techniques to both formulate and cross-check results. " + 

            "Thus, systems integration is seen as promising and perhaps necessary for true AI, especially the integration of symbolic and connectionist models. ";


    // Annotate an example document.
    //CoreDocument doc = new CoreDocument(text); 

        //pipeline.annotate(doc);

        String outputFile = "ConnllTest1.txt";
        OutputStream stream;
        try {
            stream = new FileOutputStream(outputFile);
            Writer w = new BufferedWriter( new OutputStreamWriter(stream));
            pipeline.conllPrint(pipeline.process(text), w);
        } catch (IOException e) {
            // TODO Auto-generated catch block
            e.printStackTrace();
        }

0 个答案:

没有答案