在Windows10上执行mapreduce(map reduce)程序时出错

时间:2018-06-03 01:26:27

标签: hadoop mapreduce hadoop2

Good Moring All请帮我解决问题

存储到Hadoop(HDFS)的数据

C:\ Users \ intex> hadoop fs -cat /input_dir/input_file.txt

23   23   27  43   24   25   26   26   26   26   25   26  25
26   27   28  28   28   30   31   31   31   30   30   30  29
31   32   32  32   33   34   35   36   36   34   34   34  34
39   38   39  39   39   41   42   43   40   39   38   38  40
38   39   39  39   39   41   41   41   28   40   39   39  45
23   23   27  43   24   25   26   26   26   26   25   26  25
26   27   28  28   28   30   31   31   31   30   30   30  29
31   32   32  32   33   34   35   36   36   34   34   34  34
39   38   39  39   39   41   42   43   40   39   38   38  40

我们尝试通过命令

对上述数据运行MapReduce程序
hadoop jar E:/MapReduceClient.jar wordcount /input_dir /output_dir

系统开始提示错误,我用谷歌搜索并实施了一些他们没有工作的建议

输出如下:

18/06/03 06:39:49 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
18/06/03 06:39:52 INFO input.FileInputFormat: Total input paths to process : 1
18/06/03 06:39:53 INFO mapreduce.JobSubmitter: number of splits:1
18/06/03 06:39:53 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1527987986422_0002
18/06/03 06:39:54 INFO impl.YarnClientImpl: Submitted application application_1527987986422_0002
18/06/03 06:39:54 INFO mapreduce.Job: The url to track the job: http://ARS:8088/proxy/application_1527987986422_0002/
18/06/03 06:39:54 INFO mapreduce.Job: Running job: job_1527987986422_0002
18/06/03 06:39:58 INFO mapreduce.Job: Job job_1527987986422_0002 running in uber mode : false
18/06/03 06:39:58 INFO mapreduce.Job:  map 0% reduce 0%
18/06/03 06:39:58 INFO mapreduce.Job: Job job_1527987986422_0002 failed with state FAILED due to: Application application_1527987986422_0002 failed 2 times due to AM Container for appattempt_1527987986422_0002_000002 exited with  exitCode: -1000
For more detailed output, check application tracking page:http://ARS:8088/cluster/app/application_1527987986422_0002 Then, click on links to logs of each attempt.
Diagnostics: Failed to setup local dir /tmp/hadoop-intex/nm-local-dir, which was marked as good.
Failing this attempt. Failing the application.
18/06/03 06:39:58 INFO mapreduce.Job: Counters: 0

0 个答案:

没有答案