使用LanguageTool检测无意义和/或语法不正确的句子

时间:2012-10-22 17:19:42

标签: java nlp grammar text-processing languagetool

我需要检查文本中的咒语和语法,所以我开始使用LanguageTool API(Can be found here)。现在,当我写下他们提供的启动代码时,如下所示 -

JLanguageTool langTool = new JLanguageTool(Language.ENGLISH);
langTool.activateDefaultPatternRules();
List<RuleMatch> matches = langTool.check("Eat I rice" +
    "every day and go school to good as a boy");
for (RuleMatch match : matches) {
  System.out.println("Potential error at line " +
      match.getEndLine() + ", column " +
      match.getColumn() + ": " + match.getMessage());
  System.out.println("Suggested correction: " +
      match.getSuggestedReplacements());
}

我没有收到任何错误。对不起,如果我错了,但是句子是“每天吃饭,并像男孩一样上学”这句话是正确的句子(语法上)?如果是,或者如果没有,那么有没有办法用这个工具检测这样的句子(无意义和/或语法错误)?

1 个答案:

答案 0 :(得分:2)

语言工具是基于规则的。显而易见的是,“我每天都吃饭,并且像男孩一样上学”这句话并没有受到任何规则的限制。

http://wiki.languagetool.org/tips-and-tricks有关于如何将用户定义的规则添加到Languagetool的信息。

以下是此类规则的示例:

<rule>
  <pattern>
    <token>
      <exception regexp="yes">(that|ha[ds]|will|must|could|can|should|would|does|did|may|might|t|let)</exception>
      <exception inflected="yes" regexp="yes">feel|hear|see|watch|prevent|help|stop|be</exception>
      <exception postag="C[CD]|IN|DT|MD|NNP|\." postag_regexp="yes"></exception>
      <exception scope="previous" postag="PRP$"/>
    </token>
    <token postag="NNP" regexp="yes">.{2,}<exception postag="JJ|CC|RP|DT|PRP\$?|NNPS|NNS|IN|RB|WRB|VBN" postag_regexp="yes"></exception></token>
    <marker>
      <token postag="VB|VBP" postag_regexp="yes" regexp="yes">\p{Lower}+<exception postag="VBN|VBD|JJ|IN|MD" postag_regexp="yes"></exception></token>
    </marker>
    <token postag="IN|DT" postag_regexp="yes"></token>
  </pattern>
  <message>The proper name in singular (<match no="2"></match>) must be used with a third-person verb: <suggestion><match no="3" postag="VBZ"></match></suggestion>.</message>
  <short>Grammatical problem</short>
  <example correction="walks" type="incorrect">Ann <marker>walk</marker> to the building.</example>
  <example type="correct">Bill <marker>walks</marker> to the building.</example>
  <example type="correct">Guinness <marker>walked</marker> to the building.</example>
  <example type="correct">Roosevelt and Hoover speak each other's lines.</example>
  <example type="correct">Boys are at higher risk for autism than girls.</example>
  <example type="correct">In reply, he said he was too old for this.</example>
  <example type="correct">I can see Bill looking through the window.</example>
  <example type="correct">Richard J. Hughes made his Morris County debut in his bid for the Democratic gubernatorial elections.</example>
  <example type="correct">... last night got its seven-concert Beethoven cycle at Carnegie Hall off to a good start.</example>
  <example type="correct">... and through knowing Him better to become happier and more effective people.</example>
  <!-- TODO: Fix false-positive: The library and Medical Center are to the north.-->
  <!-- The present Federal program of vocational education began in 1917. -->
</rule>

有一个在线规则编辑器

http://community.languagetool.org/ruleEditor2/

问题的简单解决方案是

<!-- English rule, 2014-09-19 --> 
<rule id="ID" name="EatI"> 
   <pattern> <token>Eat</token> <token>i</token> </pattern> 
   <message>Instead of <match no="2"/> <match no="1"/> it should be <match no="1"/> <match no="2"/></message> 
  <url>http://stackoverflow.com/questions/13016469/detecting-meaningless-and-or-grammatically-incorrect-sentence-with-languagetool/25933907#25933907</url> 
  <short>wrong order of verb and nown</short> 
  <example type='incorrect'><marker>Eat i</marker> rice</example> <example type='correct'>I eat rice</example> 
</rule>

但当然这只会涵盖动词“吃” - 但我希望你能了解它是如何运作的......