无法使用StorageClass“ slow”调配卷:无法获取错误为<nil>的GCE GCECloudProvider

时间:2019-06-02 23:28:28

标签: kubernetes google-kubernetes-engine

我正在尝试从GKE中安装Redis集群(StatefulSet),并且在获取pvc时我已经有了

Events:
  Type       Reason              Age   From                         Message
  ----       ------              ----  ----                         -------
  Warning    ProvisioningFailed  10s   persistentvolume-controller  Failed to provision volume with StorageClass "slow": Failed to get GCE GCECloudProvider with error <nil>

已经在文件/etc/kubernetes/manifests/kube-controller-manager.yaml和sudo vi /etc/kubernetes/manifests/kube-apiserver.yaml中添加了“ --cloud-provider = gce”。重新启动,但仍然相同。 谁能帮我吗?使k8在GCP上运行的诀窍是什么?

我的清单来自here

---
apiVersion: v1
kind: ConfigMap
metadata:
  name: redis-cluster
  labels:
    app: redis-cluster
data:
  fix-ip.sh: |
    #!/bin/sh
    CLUSTER_CONFIG="/data/nodes.conf"
    if [ -f ${CLUSTER_CONFIG} ]; then
      if [ -z "${POD_IP}" ]; then 
        echo "Unable to determine Pod IP address!"
        exit 1
      fi
      echo "Updating my IP to ${POD_IP} in ${CLUSTER_CONFIG}"
      sed -i.bak -e "/myself/ s/[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}/${POD_IP}/" ${CLUSTER_CONFIG}
    fi
    exec "$@"
  redis.conf: |+
    cluster-enabled yes
    cluster-require-full-coverage no
    cluster-node-timeout 15000
    cluster-config-file /data/nodes.conf
    cluster-migration-barrier 1
    appendonly yes
    protected-mode no
---
kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: slow
provisioner: kubernetes.io/gce-pd
parameters:
  type: pd-standard
  replication-type: none
  zone: "us-west2-a"
  reclaimPolicy: Retain
---
apiVersion: v1
kind: Service
metadata:
  name: redis-cluster
  labels:
    app: redis-cluster
spec:
  ports:
  - port: 6379
    targetPort: 6379
    name: client
  - port: 16379
    targetPort: 16379
    name: gossip
  clusterIP: None
  selector:
    app: redis-cluster
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: redis-cluster
  labels:
    app: redis-cluster
spec:
  serviceName: redis-cluster
  replicas: 5
  selector:
    matchLabels:
      app: redis-cluster
  template:
    metadata:
      labels:
        app: redis-cluster
    spec:
      containers:
      - name: redis
        image: redis:5.0-rc
        ports:
        - containerPort: 6379
          name: client
        - containerPort: 16379
          name: gossip
        command: ["/conf/fix-ip.sh", "redis-server", "/conf/redis.conf"]
        args:
        - --cluster-announce-ip
        - "$(POD_IP)"
        readinessProbe:
          exec:
            command:
            - sh
            - -c
            - "redis-cli -h $(hostname) ping"
          initialDelaySeconds: 15
          timeoutSeconds: 5
        livenessProbe:
          exec:
            command:
            - sh
            - -c
            - "redis-cli -h $(hostname) ping"
          initialDelaySeconds: 20
          periodSeconds: 3
        env:
        - name: POD_IP
          valueFrom:
            fieldRef:
              fieldPath: status.podIP
        volumeMounts:
        - name: conf
          mountPath: /conf
          readOnly: false
        - name: data
          mountPath: /data
          readOnly: false
      volumes:
      - name: conf
        configMap:
          name: redis-cluster
          defaultMode: 0755
  volumeClaimTemplates:
  - metadata:
      name: data
      labels:
        name: redis-cluster
    spec:
      accessModes: [ "ReadWriteOnce" ]
      storageClassName: slow 
      resources:
        requests:
          storage: 5Gi

2 个答案:

答案 0 :(得分:0)

Google提供了两种主要的持久磁盘类型,它们在kubernetes上自动配置:

Standard storage (labeled pd-standard)
SSD storage (labeled pd-ssd)

默认情况下,GKE将置备标准存储永久性磁盘。实际上,这是一开始唯一可用的存储类别。

apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: test-storageclass
provisioner: kubernetes.io/gce-pd
parameters:
  type: pd-ssd

您可以告诉持久卷使用具有以下键/值对的新ssd存储类:storageClassName: ssd.

kind: PersistentVolumeClaim
apiVersion: v1
metadata:
  name: ssd-storageclass
spec:
  accessModes:
    - ReadWriteOnce
  storageClassName: ssd
  resources:
    requests:
      storage: 1Gi

答案 1 :(得分:0)

请验证您的“ StorageClass:缓慢”,似乎存在缩进问题(从reclaimPolicy开始)

kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: slow
provisioner: kubernetes.io/gce-pd
parameters:
  type: pd-standard
  replication-type: none
  zone: "us-west2-a"
reclaimPolicy: Retain

# 更新:

  1. 请将--cloud-provider=gce添加到kube-apiserver.yaml, kube-controller-manager.yaml, KUBELET_KUBECONFIG_ARGS中。您还可以启用 enable-admission-plugins = DefaultStorageClass

  2. “ Cloud API访问范围”权限中验证您的“ VM实例详细信息”

  3. 验证存储类pv和pvc是否正常运行。


  kind: StorageClass
    apiVersion: storage.k8s.io/v1beta1
    metadata:
      name: slow
      annotations:
        storageclass.beta.kubernetes.io/is-default-class: "true" 
    provisioner: kubernetes.io/gce-pd
    parameters:
      type: pd-standard      

  apiVersion: v1
    kind: PersistentVolumeClaim
    metadata:
     name: pvc-test
    spec:
     accessModes:
      - ReadOnlyMany
     storageClassName: slow
     resources:
       requests:
         storage: 1Gi