错误:java hadoop中预期的<identifier>

时间:2017-04-13 02:36:50

标签: java hadoop mapreduce java-7 bigdata

我正在为字数hadoop编译一个java文件,但是当它编译它时会抛出一个错误:

  

CountBook.java:33:错误:期望public void reduce(Text_key,Iteratorvalues,OutputCollectoroutput,Reporter reporter)抛出IOException

这是我的代码

public class CountBook
{
    public static class EMapper extends MapReducebase implements
    Mapper<LongWritable,Text,Text,IntWritable>
    {
        private final static Intwritable one = new Intwritable(1);
        public void map(LongWritable key,Text value,OutputCollector<Text,IntWritable>output,Reporter reporter)throws IOException
        {
            String line = value.toString();
            String[] Data = line.split("\";\"");
            output.collect(new text(Data[0]),one);

        }
    }


public static class EReduce extends MapReduceBase implements
Reducer<Text,IntWritable,Text,IntWritable>
{
    public void reduce(Text_key,Iterator<IntWritable>values,OutputCollector<text,intWritable>output,Reporter reporter)throws IOException
    {
        Text key=_key;
        int authid=0;
        while(values.hasNext())
        {
            IntWritable value = (IntWritable)values.next();
            authid+=value.get();
        }
        output.collect(key,new intWritable(authid));
    }
}


public static void main(String args[])throws Exception
{
    JobConf conf = new JbConf(CountBook.class);
    conf.setjobName("CountBookByAuthor");
    conf.setOutputkeyClass(Text.class);
    conf.setOutputValueClass(IntWritable.class);
    conf.setMapperClass(EMapper.class);
    conf.setCombinerClass(EReduce.class);
    conf.setReducerClass(EReducer.class);
    conf.setOutputFormat(TextOutputFormat.class);
    FileInputFormat.setInputPaths(conf,new path(args[0]));
    FileOutputFormat.setOutputPath(conf,new Path(args[1]));
    JobCLient.runJob(conf);
}
}

我正在使用hadoop-core-1.2.1.jar进行类路径库并在centos 7中运行

1 个答案:

答案 0 :(得分:1)

您目前有:

reduce(Text_key, 
       Iterator<IntWritable>values,
       OutputCollector<text,intWritable>output, 
       Reporter reporter)

应该是:

reduce(Text key, 
       Iterator<IntWritable> values,
       OutputCollector<Text,IntWritable> output, 
       Reporter reporter)

主要区别为key需要在TextOutputCollector<>之间留出空格,而\n中的类型需要加以优化。