我在Ubuntu 12.04上运行Hadoop管道作业,但是当缩减器启动时出现了Broken Pipe错误:
2013-04-17 10:40:38,088 INFO org.apache.hadoop.mapred.ReduceTask:合并0段,从内存中将0个字节合并为reduce 2013-04-17 10:40:38,088 INFO org.apache.hadoop.mapred.Merger:合并1个已排序的细分 2013-04-17 10:40:38,088 INFO org.apache.hadoop.mapred.Merger:向下到最后一次合并传递,剩下1个段的总大小:1795675字节 2013-04-17 10:40:38,118 INFO org.apache.hadoop.mapred.pipes.PipesReducer:启动应用程序 2013-04-17 10:40:38,264 INFO org.apache.hadoop.mapred.pipes.PipesReducer:等待完成 2013-04-17 10:40:38,265 ERROR org.apache.hadoop.mapred.pipes.BinaryProtocol:java.net.SocketException:Connection reset 在java.net.SocketInputStream.read(SocketInputStream.java:189) 在java.net.SocketInputStream.read(SocketInputStream.java:121) 在java.io.BufferedInputStream.fill(BufferedInputStream.java:235) 在java.io.BufferedInputStream.read(BufferedInputStream.java:254) 在java.io.DataInputStream.readByte(DataInputStream.java:265) 在org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:299) 在org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:320) 在org.apache.hadoop.mapred.pipes.BinaryProtocol $ UplinkReaderThread.run(BinaryProtocol.java:121)
2013-04-17 10:40:38,265 INFO org.apache.hadoop.mapred.pipes.Application:因java.net.SocketException而中止:管道损坏 at java.net.SocketOutputStream.socketWrite0(Native Method) 在java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109) 在java.net.SocketOutputStream.write(SocketOutputStream.java:153) 在java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82
提前感谢任何帮助。