MapReduce作业永远不会进入运行状态

Question

我有一个小的jar文件，它是正确的，因为我在其他计算机上对其进行了测试，并且可以与hadoop一起使用。

现在我已经在我的电脑上设置了hadoop，当我提交作业时，它就永远不会超过接受状态。

在浏览器中，我可以看到该作业已被接受但从未执行过。这是屏幕截图。

我看到控制台中出现警告：

WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.

完整日志是：

   C:\Users\afraz\Desktop\MapReduceData>hadoop jar outs.jar 1902 spo
2019-05-01 22:27:40,842 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
2019-05-01 22:27:41,882 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2019-05-01 22:27:41,925 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/afraz/.staging/job_1556742397967_0001
2019-05-01 22:27:42,890 INFO input.FileInputFormat: Total input files to process : 1
2019-05-01 22:27:43,048 INFO mapreduce.JobSubmitter: number of splits:1
2019-05-01 22:27:43,250 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1556742397967_0001
2019-05-01 22:27:43,254 INFO mapreduce.JobSubmitter: Executing with tokens: []
2019-05-01 22:27:43,543 INFO conf.Configuration: resource-types.xml not found
2019-05-01 22:27:43,544 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2019-05-01 22:27:44,093 INFO impl.YarnClientImpl: Submitted application application_1556742397967_0001
2019-05-01 22:27:44,155 INFO mapreduce.Job: The url to track the job: http://LAPTOP-PN52M98R:8088/proxy/application_1556742397967_0001/
2019-05-01 22:27:44,157 INFO mapreduce.Job: Running job: job_1556742397967_0001

任何帮助都会很棒。

Answer 1

似乎您没有活动的NodeManagers

Memory Total: 0B   VCores Total: 0
Unhealthy Nodes: 1

您的作业已被ResourceManager接受，但是只有在有可用资源启动之前，该作业才能运行

我建议在您的计算机上找到NodeManager日志文件，然后查看那里是否提到任何明显的异常