Question

我在Windows 8上安装的hadoop上运行mapreduce wordcount示例。我收到如下错误。这听起来像是一个安全许可问题。但我不太确定。我在yarn-site.xml文件中添加了一个属性

<property>
        <name>yarn.nodemanager.local-dirs</name>
        <value>c:\hadoop\tmp-nm</value>
</property>

任何想法都会非常有用！

15/07/15 11:01:54 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
15/07/15 11:01:55 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
15/07/15 11:01:56 INFO input.FileInputFormat: Total input paths to process : 2
15/07/15 11:01:56 INFO mapreduce.JobSubmitter: number of splits:2
15/07/15 11:01:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1436976054610_0001
15/07/15 11:01:57 INFO impl.YarnClientImpl: Submitted application application_1436976054610_0001
15/07/15 11:01:58 INFO mapreduce.Job: The url to track the job: http://localhost:8088/proxy/application_1436976054610_0001/
15/07/15 11:01:58 INFO mapreduce.Job: Running job: job_1436976054610_0001
15/07/15 11:02:03 INFO mapreduce.Job: Job job_1436976054610_0001 running in uber mode : false
15/07/15 11:02:03 INFO mapreduce.Job:  map 0% reduce 0%
15/07/15 11:02:03 INFO mapreduce.Job: Job job_1436976054610_0001 failed with state FAILED due to: Application application_1436976054610_0001 failed 2
times due to AM Container for appattempt_1436976054610_0001_000002 exited with  exitCode: -1000
For more detailed output, check application tracking page:http://localhost:8088/cluster/app/application_1436976054610_0001Then, click on links to logs of each attempt.
Diagnostics: Failed to setup local dir c:/hadoop/tmp-nm, which was marked as good.
Failing this attempt. Failing the application.
15/07/15 11:02:03 INFO mapreduce.Job: Counters: 0

Answer 1

我遇到了同样的问题。这是一个权限问题，您基本上需要将所有权更改为c：/ hadoop / tmp-nm文件夹中所有文件夹的用户帐户。尝试仅更改tmp-nm的所有权将无效，因为您必须手动更改tmp-nm内所有子文件夹的所有权。

Mapreduce错误：无法设置本地目录

1 个答案: