Question

需要您对此主题的意见和专业知识。

我已经配置了FAIR_TEST队列，并将Ordering设置为FAIR
已在fair-scheduler.xml默认路径HADOOP_CONF_DIR中添加了(/usr/hdp/3.1.0.0-78/hadoop/conf)，并设置了minResources和 maxResources分别为4 GB和8 GB。
将Ambari中的Scheduler类更改为Fair Scheduler类，并添加了一个参数 "yarn.scheduler.fair.allocation.file"指向上述XML 文件。

在Ambari中重新启动受YARN影响的组件时，出现以下错误：

能否让我知道发生了什么问题以及如何解决此问题。

*2019-12-19 09:48:17,762 INFO service.AbstractService (AbstractService.java:noteFailure(267)) - Service NodeManager failed in state INITED
java.lang.RuntimeException: java.lang.RuntimeException: class org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler not org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2628)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.createContainerExecutor(NodeManager.java:347)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:389)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:933)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:1013)
Caused by: java.lang.RuntimeException: class org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler not org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2622)*

公平调度程序XML文件如下：

<configuration xmlns:xi="http://www.w3.org/2001/XInclude">

<allocations>
    <queue name="FAIR-TEST">
        <minResources>4096 mb,0vcores</minResources>
        <maxResources>8192 mb,0vcores</maxResources>
        <maxRunningApps>50</maxRunningApps>
        <maxAMShare>0.1</maxAMShare>
        <weight>30</weight>
        <schedulingPolicy>fair</schedulingPolicy>
    </queue>

    <queuePlacementPolicy>
        <rule name="specified" />
        <rule name="default" queue="FAIR-TEST" />   
    </queuePlacementPolicy>
</allocations>

无法启动节点管理器

0 个答案: