mapreduce作业未运行

时间:2016-04-28 07:52:58

标签: java hadoop mapreduce yarn

我正在尝试运行mapreduce但能够运行低于错误

16/04/28 13:17:07 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/04/28 13:17:07 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/04/28 13:17:08 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:09 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:10 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:11 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:12 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:13 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
16/04/28 13:17:14 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

请注意我已经检查了问题no 20620949和toster.ru/q/57046#answer_208326以及许多其他相关的验证以上Ifound纱线没有安装在我的本地机器上,所以请让我知道纱线是否需要运行单机中的MR工作我的意思是在我的本地linux机箱中(没有任何集群),我们可以在没有纱线的情况下运行MR作业吗?

3 个答案:

答案 0 :(得分:0)

使用hadoop-2它YARN是默认的调度程序,它管理资源/容器。 因此必须有YARN。您可以在单个主机上启动YARN服务,它不需要任何群集。

答案 1 :(得分:0)

从技术上讲,您不需要安装YARN。在这种情况下,您需要安装hadoop-mapreduce-v1。但是MRv1已被弃用,您不应该使用它。我的猜测是你已经安装了YARN,但你还没有启动该服务。

您可以做的其他事情之一是从其中一个Hadoop分发供应商那里获得一个开箱即用的图像:Cloudera或Hortonworks。

答案 2 :(得分:0)

现在解决了,我正在使用厨师进行部署,在那里我找不到“start-yarn.sh”但是我们全部作为服务,当我启动服务“hadoop-yarn-resourcemanager”它开始工作时, 谢谢你的建议和评论。