我对我的语法进行了一次小小的审讯。 我想解析字符串,如下所示:
"(ICOM LIKE '%bridge%' or ICOM LIKE '%Munich%')"
我最终得到了以下语法(比我知道的要复杂得多):
//旨在解析完整的BQS形成的查询
grammar Logic;
options {
output=AST;
}
tokens {
NOT_LIKE;
}
/*------------------------------------------------------------------
* PARSER RULES
*------------------------------------------------------------------*/
// precedence order is (low to high): or, and, not, [comp_op, geo_op, rel_geo_op, like, not like, exists], ()
parse
: expression EOF -> expression
; // ommit the EOF token
expression
: query
;
query
: term (OR^ term)* // make `or` the root
;
term
: factor (AND^ factor)*
;
factor
: (notexp -> notexp) ( NOT LIKE e=notexp -> ^(NOT_LIKE $factor $e))?
;
notexp
: NOT^ like
| like
;
like // this one has to be completed (a lot)
: atom (LIKE^ atom)*
;
atom
: ID
| | '(' expression ')' -> expression
;
/*------------------------------------------------------------------
* LEXER RULES
*------------------------------------------------------------------*/
// GENERAL OPERATORS:
//NOTLIKE : 'notlike' | 'NOTLIKE'; // whitespaces have been removed
LIKE : 'like' | 'LIKE';
OR : 'or' | 'OR';
AND : 'and' | 'AND';
NOT : 'not' | 'NOT';
//ELEMENTS
CONSTANT_EXPRESSION : DATE | NUMBER | QUOTED_STRING;
ID : (CHARACTER|DIGIT)+;
WHITESPACE : ( '\t' | ' ' | '\r' | '\n'| '\u000C' )+ { $channel = HIDDEN; } ;
fragment DATE : '\'' YEAR '/' MONTH '/' DAY (' ' HOUR ':' MINUTE ':' SECOND)? '\'';
fragment QUOTED_STRING : '\'' (CHARACTER)+ '\'' ;
//UNITS
fragment CHARACTER : ('a'..'z' | 'A'..'Z'|'.'|'\''|'%'); // FIXME: Careful, should be all ASCII
fragment DIGIT : '0'..'9' ;
fragment DIGIT_SEQ :(DIGIT)+;
fragment DEL : SPACE ',' SPACE ; //Delimiter + may be space behind
fragment NUMBER : (SIGN)? DIGIT_SEQ ('.' (DIGIT_SEQ)?)?; // should be given in decimal degrees, North is 0 and direction is clockwise, range is 0 to 360
fragment SIGN : '+' | '-';
fragment YEAR : DIGIT DIGIT DIGIT DIGIT;
fragment MONTH : DIGIT DIGIT;
fragment DAY : DIGIT DIGIT;
fragment HOUR : DIGIT DIGIT;
fragment MINUTE : DIGIT DIGIT;
fragment SECOND : DIGIT (DIGIT)? ('.' (DIGIT)+)?;
fragment SPACE : (' ')?;// used to increase compatibility
事情是,我在创建AST时有这条消息:
line 1:11 no viable alternative at input ''%bridge%''
line 1:35 no viable alternative at input ''%Munich%''
生成的树虽然正确(至少我担心):
那么,有人能给我一个关于那里有什么问题的暗示吗?我认为character包含了correclty解析这个表达式所需的所有额外字符。 。 。
谢谢!
像往常一样,一些Java代码可以快速测试语法:import org.antlr.runtime.*;
import org.antlr.runtime.tree.*;
import org.antlr.stringtemplate.*;
public class Main {
public static void main(String[] args) throws Exception {
// the expression
String src = "(ICOM LIKE '%bridge%' or ICOM LIKE '%Munich%')";
// create a lexer & parser
//LogicLexer lexer = new LogicLexer(new ANTLRStringStream(src));
//LogicParser parser = new LogicParser(new CommonTokenStream(lexer));
LogicLexer lexer = new LogicLexer(new ANTLRStringStream(src));
LogicParser parser = new LogicParser(new CommonTokenStream(lexer));
// invoke the entry point of the parser (the parse() method) and get the AST
CommonTree tree = (CommonTree)parser.parse().getTree();
// print the DOT representation of the AST
DOTTreeGenerator gen = new DOTTreeGenerator();
StringTemplate st = gen.toDOT(tree);
System.out.println(st);
}
}
答案 0 :(得分:7)
我看到3个问题:
您的atom
规则与epsilon(无)匹配:
atom
: ID
| | '(' expression ')' -> expression
;
(请注意| |
内的“虚无”)
导致你的语法含糊不清。我想它应该是:
atom
: ID
| '(' expression ')' -> expression
;
您的fragment CHARACTER
匹配单引号,而此单引号也表示fragment QUOTED_STRING
的结尾。
我想CHARACTER
应该是这样的:
fragment CHARACTER : ('a'..'z' | 'A'..'Z' | '.' | '%');
您的解析器规则中没有任何地方与令牌CONSTANT_EXPRESSION
匹配,因此您发布的AST永远不会由您发布的语法生成的解析器创建。我认为你想要在atom
规则中匹配它:
atom
: ID
| CONSTANT_EXPRESSION
| '(' expression ')' -> expression
;
通过上面列出的更改,我得到以下AST而没有任何错误打印到控制台: