Question

我正在尝试在HDInsights上学习Hadoop 1.1.0版。我按照分步说明在Hadoop命令行上运行命令。我首先编译了java代码，然后创建了一个jar文件，然后执行了map reduce命令。但是当我运行mapreduce命令时，它会给我下面的错误。有人可以帮助我理解错误的含义以及我需要做些什么来纠正它？

c:\hadoop-training\mrdcache>hadoop jar DCache.jar DCache mrdcache/input/nyse mrdcache/output

13/08/08 23:29:01 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/08/08 23:29:01 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:8020/hadoop/hdfs/tmp/mapred/staging/Ramya/.staging/job_201308082321_0001
13/08/08 23:29:01 ERROR security.UserGroupInformation: PriviledgedActionException as:myusername cause:java.io.FileNotFoundException: File does not exist: mrdcache/output Exception in thread "main" java.io.FileNotFoundException: File does not exist: mrdcache/output
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:518)
    at org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
    at org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:750)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
    at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
    at org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
    at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
    at DCache.main(Dcache.java:199)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at     sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

感谢任何帮助！谢谢，拉姆亚

Answer 1

文件在哪里？你应该像这样使用ASV： hadoop jar C：\ Tutorials \ log4jMapReduce.jar log4jMapReduce asv：///sample.log asv：/// Tutorials / output

http://www.windowsazure.com/en-us/manage/services/hdinsight/using-mapreduce-with-hdinsight/

错误security.UserGroupInformation：PriviledgedActionException

1 个答案: