重新启动集群中的所有k8s pod?

时间:2020-04-02 22:42:55

标签: kubernetes cron load-balancing pod

重新启动集群中所有Pod的最佳方法是什么?我当时想在kubernetes中设置一个cronjob任务以正常执行此操作,并确保集群平均负载均衡,但是在正常情况下执行此操作的最佳实践是什么?另外,将其作为一次性任务的最佳方法是什么?

2 个答案:

答案 0 :(得分:3)

这是一个坏主意。请改用https://github.com/kubernetes-sigs/descheduler并有选择地进行实际分析:)

但这就是kubectl delete pod --all --all-namespaces或类似的内容。

答案 1 :(得分:0)

如果你想从 CronJob 运行它,这意味着你需要在里面有管理员的 kubeconfig 以便从 POD 连接到 kube-api。对我来说这是一种风险,因为任何连接到 POD 的人都会获得您的 kubeconfig。所以我更喜欢通过 kubectl 命令从本地机器运行它。

当然 - 对我来说,所有 POD 都是指控制平面的组件以及所有部署、Statefulset 和 DaemonSet。

您可以选择 delete podrollout restart (kubectl cheetsheet)。我更喜欢第二种方式,因为它会在 POD 后重新启动 POD 并保持应用程序的 HA。

因为我今天解决了一个类似的问题,所以我写了我自己的脚本,你可以在下面找到。没什么特别的 - 它会询问您有关 K8s 上下文的信息,并且在没有 --restart 参数的情况下,它会空运行所有重启命令。 :]

#! /bin/env bash

# Help
[[ ${1} == "--help" ]] && echo "Usage: $0 [--restart]" && exit 0

# Run restart process
if [[ ${1} != "" ]]; then
  if [[ ${1} == "--restart" ]]; then
    RUN_RESTART="true" 
  else
    echo "This parameter is strange, check it: ${}"
    exit 1
  fi
fi

###
### VARIABLES
###
SLEEP=10
KUBECTL="kubectl"

###
### CONFIRM CONTEXT
###
echo -e "\nConfirm your context: $(${KUBECTL} config current-context): [enter / ctrl+c]"
echo -e "~~~~~~~~~~~~~~~~~~~~~~~\n"

read

###
### RESTART ALL K8s SERVICES
###
echo -e "\n\n>>>>>>>>>>>>>>><<<<<<<<<<<<<<<<<"
echo ">>> RESTART ALL K8s SERVICES <<<"
echo ">>>>>>>>>>>>>>><<<<<<<<<<<<<<<<<"
CONTROL_PLANE=$(${KUBECTL} get node -l node-role=master -o jsonpath='{range .items[*]}{@.metadata.name}{"\n"}')
for master in ${CONTROL_PLANE}; do
  echo "Master: ${master}"
  echo "~~~~~~~~~~~~~~~~~~~~~"
  CP_PODS=$(${KUBECTL} -n kube-system get pods --field-selector spec.nodeName=${master} -o jsonpath='{range .items[*]}{@.metadata.name}{"\n"}' | grep -E -- 'etcd|^kube-')

  for pod in ${CP_PODS}; do
    CP_RESTART="${KUBECTL} -n kube-system delete pod ${pod}"
    if [[ ${RUN_RESTART} == "true" ]]; then
      echo "  * [$(date '+%F %T')] Run command: ${CP_RESTART}"
      ${CP_RESTART} && echo
      sleep ${SLEEP}
    else
      echo "  * ${CP_RESTART}"
    fi
  done
  echo -e "~~~~~~~~~~~~~~~~~~~~~~~\n\n"
done

###
### RESTART ALL Deployments, ReplicaSets and DaemonSets
###
echo ">>>>>>>>>>>>>>>>>>>>>>>>>>>>><<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<"
echo ">>> RESTART ALL Deployments, StatefullSets and DaemonSets <<<"
echo ">>>>>>>>>>>>>>>>>>>>>>>>>>>><<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<"
for ns in $(${KUBECTL} get ns -o jsonpath='{range .items[*]}{@.metadata.name}{"\n"}'); do 
  # Check if in the namespace are PODs
  # PODS=$(${KUBECTL} -n ${ns} get pod -o jsonpath='{range .items[*]}{@.metadata.name}{"\n"}')
  # echo ">>> ${ns}: $PODS"
  # if [[ "${PODS}" != "" ]]; then
    # ns="ms"
    echo "Namespace: $ns"
    echo "~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~"

    echo "  >> Deployments:"
    for deployment in $(${KUBECTL} -n $ns get deployments.apps -o jsonpath='{range .items[*]}{@.metadata.name}{"\n"}'); do
      DEPL_RESTART="${KUBECTL} -n ${ns} rollout restart deployments.apps ${deployment}"
      if [[ ${RUN_RESTART} == "true" ]]; then
        echo "     * [$(date '+%F %T')] Run command: ${DEPL_RESTART}"
        ${DEPL_RESTART} && echo
        sleep ${SLEEP}
      else
        echo "     * ${DEPL_RESTART}"
      fi
    done

    echo "  >> StatefulSets:"
    for rs in $(${KUBECTL} -n $ns get statefulset -o jsonpath='{range .items[*]}{@.metadata.name}{"\n"}'); do
      RS_RESTART="${KUBECTL} -n ${ns} rollout restart statefulset ${rs}"
      if [[ ${RUN_RESTART} == "true" ]]; then 
        echo "     * [$(date '+%F %T')] Run command: ${RS_RESTART}"
        ${RS_RESTART} && echo
        sleep ${SLEEP}
      else
        echo "     * ${RS_RESTART}"
      fi
    done
    
    echo "  >> DaemonSets:"
    for ds in $(${KUBECTL} -n $ns get daemonsets.apps -o jsonpath='{range .items[*]}{@.metadata.name}{"\n"}'); do
      DS_RESTART="${KUBECTL} -n ${ns} rollout restart daemonsets.apps ${ds}"
      if [[ ${RUN_RESTART} == "true" ]]; then
        echo "     * [$(date '+%F %T')] Run command: ${DS_RESTART}"
        ${DS_RESTART} && echo
        sleep ${SLEEP}
      else
        echo "     * ${DS_RESTART}"
      fi
    done
    echo -e "~~~~~~~~~~~~~~~~~~~~~~~\n\n"
done