Cloudera ToolRunner

时间:2015-09-15 13:14:28

标签: hive cloudera hue toolrunner

我正在使用Hue访问Hive Service。我使用

创建了一个Hive表
create table tablename(colname type,.....) 
row format delimited fields terminated by ',';

我完全上传了30万条记录的数据。但在执行如下查询时:

select count(*) from tablename;

它正在创建MapReduce作业,此时我收到以下警告,如何解决此警告。

  

警告:未执行Hadoop命令行选项解析。实行   工具界面并使用ToolRunner执行您的应用程序   解决这个问题。

完成日志:

INFO  : Number of reduce tasks determined at compile time: 1
INFO  : In order to change the average load for a reducer (in bytes):
INFO  :   set hive.exec.reducers.bytes.per.reducer=<number>
INFO  : In order to limit the maximum number of reducers:
INFO  :   set hive.exec.reducers.max=<number>
INFO  : In order to set a constant number of reducers:
INFO  :   set mapreduce.job.reduces=<number>
WARN  : Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
INFO  : number of splits:1
INFO  : Submitting tokens for job: job_1442315442114_0017
INFO  : The url to track the job: http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO  : Starting Job = job_1442315442114_0017, Tracking URL = http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO  : Kill Command = /opt/cloudera/parcels/CDH-5.4.4-1.cdh5.4.4.p0.4/lib/hadoop/bin/hadoop job  -kill job_1442315442114_0017
INFO  : Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
INFO  : 2015-09-15 18:29:06,910 Stage-1 map = 0%,  reduce = 0%
INFO  : 2015-09-15 18:29:15,257 Stage-1 map = 100%,  reduce = 0%, Cumulative CPU 1.65 sec
INFO  : 2015-09-15 18:29:21,513 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 3.19 sec
INFO  : MapReduce Total cumulative CPU time: 3 seconds 190 msec
INFO  : Ended Job = job_1442315442114_0017

1 个答案:

答案 0 :(得分:0)

这只是一个来自MapReduce的警告,因为Hive提交的作业没有实现该接口。这可以安全地忽略。

有关Tool Runner的更多信息。