Question

我在Dask Helm Chart上安装了经过修订的values.yaml，使其具有10 workers，但是我想创建Dask Workers而不是Dash CUDA Workers来利用NVIDIA我的multi-node集群上的GPU。

我尝试如下修改values.yaml以获得Dask CUDA workers而不是Dask Workers，但是工作包可以启动。按照官方的说明，我已经在Kubernetes的所有节点上都安装了NVIDIA GPU，所以我不确定创建Dask-Cuda-Workers所需的DASK是什么。

worker:
  name: worker
  image:
    repository: "daskdev/dask"
    tag: 2.19.0
    pullPolicy: IfNotPresent
    dask_worker: "dask-cuda-worker"
    #dask_worker: "dask-worker"
    pullSecrets:
    #  - name: regcred
  replicas: 15
  default_resources:  # overwritten by resource limits if they exist
    cpu: 1
    memory: "4GiB"
  env:
  #  - name: EXTRA_APT_PACKAGES
  #    value: build-essential openssl
  #  - name: EXTRA_CONDA_PACKAGES
  #    value: numba xarray -c conda-forge
  #  - name: EXTRA_PIP_PACKAGES
  #    value: s3fs dask-ml --upgrade
  resources: {}
  #  limits:
  #    cpu: 1
  #    memory: 3G
  #    nvidia.com/gpu: 1
  #  requests:
  #    cpu: 1
  #    memory: 3G
  #    nvidia.com/gpu: 1

Answer 1

由于dask-cuda-worker尚未正式出现在dask图像中，因此您需要将图像拉出其他图像：rapidsai/rapidsai:latest

Dask Helm Chart-如何创建Dask-CUDA-Worker节点

1 个答案: