Hadoop C ++管道,SocketException:管道损坏

时间:2013-04-17 18:35:46

标签: c++ apache hadoop socketexception broken-pipe

我在Ubuntu 12.04上运行Hadoop管道作业,但是当缩减器启动时出现了Broken Pipe错误:

2013-04-17 10:40:38,088 INFO org.apache.hadoop.mapred.ReduceTask:合并0段,从内存中将0个字节合并为reduce 2013-04-17 10:40:38,088 INFO org.apache.hadoop.mapred.Merger:合并1个已排序的细分 2013-04-17 10:40:38,088 INFO org.apache.hadoop.mapred.Merger:向下到最后一次合并传递,剩下1个段的总大小:1795675字节 2013-04-17 10:40:38,118 INFO org.apache.hadoop.mapred.pipes.PipesReducer:启动应用程序 2013-04-17 10:40:38,264 INFO org.apache.hadoop.mapred.pipes.PipesReducer:等待完成 2013-04-17 10:40:38,265 ERROR org.apache.hadoop.mapred.pipes.BinaryProtocol:java.net.SocketException:Connection reset         在java.net.SocketInputStream.read(SocketInputStream.java:189)         在java.net.SocketInputStream.read(SocketInputStream.java:121)         在java.io.BufferedInputStream.fill(BufferedInputStream.java:235)         在java.io.BufferedInputStream.read(BufferedInputStream.java:254)         在java.io.DataInputStream.readByte(DataInputStream.java:265)         在org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:299)         在org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:320)         在org.apache.hadoop.mapred.pipes.BinaryProtocol $ UplinkReaderThread.run(BinaryProtocol.java:121)

2013-04-17 10:40:38,265 INFO org.apache.hadoop.mapred.pipes.Application:因java.net.SocketException而中止:管道损坏         at java.net.SocketOutputStream.socketWrite0(Native Method)         在java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)         在java.net.SocketOutputStream.write(SocketOutputStream.java:153)         在java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82

提前感谢任何帮助。

0 个答案:

没有答案