在YARN Fair Scheduler

时间:2018-03-02 02:17:24

标签: java hadoop yarn

在YARN 2.7.3中,"固定的fairshare"没有记录,但在ComputeFairShares.java中实施。为方便起见,下面复制了功能签名。

这里用一个例子来说明我对"固定的fairshare"的理解:如果ABC队列定义为" minResoures == 100; maxResoures == 100;权重== 0",我们将有一个固定队列分配100个内存,不参与即时展会(IFS);也就是说,(1)即使ABC队列为空,其100个内存的份额也不会通过IFS分配给其他活动队列; (2)当ABC队列不为空时,它不会从其他空队列中获取IFS共享。

YARN Fair Scheduler专家可以帮助确认吗?

从ComputeFairShares.java复制的函数签名:

/**
* Helper method to handle Schedulabes with fixed fairshares.
* Returns the resources taken by fixed fairshare schedulables,
* and adds the remaining to the passed nonFixedSchedulables.
*/
private static int handleFixedFairShares(
  Collection<? extends Schedulable> schedulables,
  Collection<Schedulable> nonFixedSchedulables,
  boolean isSteadyShare, ResourceType type) {


/**
 * Get the fairshare for the {@link Schedulable} if it is fixed, -1 
   otherwise
 *
 * The fairshare is fixed if either the maxShare is 0, weight is 0,
 * or the Schedulable is not active for instantaneous fairshare.
 */
 private static int getFairShareIfFixed(Schedulable sched,
   boolean isSteadyShare, ResourceType type) {

0 个答案:

没有答案