如何在grunt shell中运行猪拉丁中的宏?

时间:2012-09-10 14:24:48

标签: hive apache-pig

我有一个宏来计算过滤数据后的记录数。但是当我在grunt shell中运行宏时,会发生以下错误:

grunt> DEFINE count_by_group(X) RETURNS Y { 
           A = GROUP $X  ALL;
           $Y = FOR EACH A GENERATE COUNT($X);
  };

出现错误:

ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999:
Unexpected internal error. Can not create a Path from a null string

在猪日志中完成堆栈跟踪:

================================================================================
Pig Stack Trace
---------------
ERROR 2999: Unexpected internal error. Can not create a Path from a null string

java.lang.IllegalArgumentException: Can not create a Path from a null string
    at org.apache.hadoop.fs.Path.checkPathArg(Path.java:78)
    at org.apache.hadoop.fs.Path.<init>(Path.java:90)
    at org.apache.pig.impl.io.FileLocalizer.fetchFilesInternal(FileLocalizer.java:770)
    at org.apache.pig.impl.io.FileLocalizer.fetchFile(FileLocalizer.java:737)
    at org.apache.pig.parser.QueryParserDriver.getMacroFile(QueryParserDriver.java:350)
    at org.apache.pig.parser.QueryParserDriver.makeMacroDef(QueryParserDriver.java:406)
    at org.apache.pig.parser.QueryParserDriver.expandMacro(QueryParserDriver.java:268)
    at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:169)
    at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1565)
    at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1538)
    at org.apache.pig.PigServer.registerQuery(PigServer.java:540)
    at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:970)
                                                                                                                                                                                              org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:189)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
    at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
    at org.apache.pig.Main.run(Main.java:490)
    at org.apache.pig.Main.main(Main.java:111)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
 ================================================================================

请帮助。提前谢谢。

此致

CHANDAN

2 个答案:

答案 0 :(得分:7)

答案 1 :(得分:2)

通过将Pig指定给关系,可以在Pig Latin代码中调用该宏。宏不能在命令行中传递。