程序的hadoop启动错误:java.io.IOException

时间:2012-08-30 11:57:25

标签: java linux hadoop mapreduce

  

可能重复:
  Error of start of hadoop of the program:PriviledgedActionException

我写了以下程序(参见Error of start of hadoop of the program:PriviledgedActionException )。

我开始了

root@one: /export/hadoop-1.0.1/bin# ./hadoop pipes -D hadoop.pipes.java.recordreader=true -D    hadoop.pipes.java.recordwriter=true -input input/paths.txt -output outnewdir1 -program bin/parindex

根据this document

我收到以下错误

12/08/30 03:40:24 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
12/08/30 03:40:24 WARN mapred.JobClient: No job jar file set.  User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
12/08/30 03:40:24 INFO mapred.FileInputFormat: Total input paths to process : 1
12/08/30 03:40:24 INFO filecache.TrackerDistributedCacheManager: Creating parindex in /tmp/hadoop-root/mapred/local/archive/-7785595679055918834_2050052313_1927350978/filebin-work--3826230438226227897 with rwxr-xr-x
12/08/30 03:40:24 INFO filecache.TrackerDistributedCacheManager: Cached bin/parindex as /tmp/hadoop-root/mapred/local/archive/-7785595679055918834_2050052313_1927350978/filebin/parindex
12/08/30 03:40:24 INFO filecache.TrackerDistributedCacheManager: Cached bin/parindex as /tmp/hadoop-root/mapred/local/archive/-7785595679055918834_2050052313_1927350978/filebin/parindex
12/08/30 03:40:24 INFO mapred.JobClient: Running job: job_local_0001
12/08/30 03:40:24 INFO mapred.Task:  Using ResourceCalculatorPlugin : null
12/08/30 03:40:24 INFO mapred.MapTask: numReduceTasks: 1
12/08/30 03:40:24 INFO mapred.MapTask: io.sort.mb = 100
12/08/30 03:40:25 INFO mapred.MapTask: data buffer = 79691776/99614720
12/08/30 03:40:25 INFO mapred.MapTask: record buffer = 262144/327680
12/08/30 03:40:25 WARN mapred.LocalJobRunner: job_local_0001
java.lang.NullPointerException
    at org.apache.hadoop.mapred.pipes.Application.<init>(Application.java:103)
    at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:68)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
12/08/30 03:40:25 INFO mapred.JobClient:  map 0% reduce 0%
12/08/30 03:40:25 INFO mapred.JobClient: Job complete: job_local_0001
12/08/30 03:40:25 INFO mapred.JobClient: Counters: 0
12/08/30 03:40:25 INFO mapred.JobClient: Job Failed: NA
Exception in thread "main" java.io.IOException: Job failed!
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1265)
    at org.apache.hadoop.mapred.pipes.Submitter.runJob(Submitter.java:248)
    at org.apache.hadoop.mapred.pipes.Submitter.run(Submitter.java:479)
    at org.apache.hadoop.mapred.pipes.Submitter.main(Submitter.java:494)

0 个答案:

没有答案