部署下游RKE2集群时卡在 waiting for probes: calico

Rancher Server 设置

  • Rancher 版本:v2.6.5
  • 安装选项 (Docker install/Helm Chart): Docker install
    • 如果是 Helm Chart 安装,需要提供 Local 集群的类型(RKE1, RKE2, k3s, EKS, 等)和版本:
  • 在线或离线部署:在线

下游集群信息

  • Kubernetes 版本: v1.22.10+rke2r2
  • Cluster Type (Local/Downstream): Downstream
    • 如果 Downstream,是什么类型的集群?(自定义/导入或为托管 等):
      Harvester

用户信息

  • 登录用户的角色是什么? (管理员/集群所有者/集群成员/项目所有者/项目成员/自定义):管理员
    • 如果自定义,自定义权限集:

问题描述:
使用Rancher在Harvester上创建RKE2集群,会一直卡在 waiting for probes: calico
重现步骤:
使用Rancher在Harvester上创建RKE2集群即可
结果:
卡在 Configuring bootstrap node(s) rke2-singal-pool1-6cb66d8f4f-n77t4: waiting for probes: calico
预期结果:
成功创建下游集群
截图:

其他上下文信息:

rancher-system-agent日志
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-calico-crd\", UID:\"739e7d50-72a9-4df7-be44-469612248a49\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"428\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-calico-crd"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-cloud-provider\", UID:\"24ef6a53-f232-47ac-b946-a787675ad091\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"297\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-cloud-provider"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-coredns\", UID:\"a66f86d8-7945-4714-999a-1296db8f85e4\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"492\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-coredns"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-cloud-provider\", UID:\"24ef6a53-f232-47ac-b946-a787675ad091\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"297\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-cloud-provider"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-csi-driver\", UID:\"03a6be92-4ef4-46b2-8a43-5f7e4318f66f\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"306\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-csi-driver"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-coredns\", UID:\"a66f86d8-7945-4714-999a-1296db8f85e4\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"492\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-coredns"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-csi-driver\", UID:\"03a6be92-4ef4-46b2-8a43-5f7e4318f66f\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"306\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-csi-driver"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-csi-driver\", UID:\"03a6be92-4ef4-46b2-8a43-5f7e4318f66f\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"306\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-csi-driver"
Jun 29 17:10:38 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:38+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-calico\", UID:\"1bc03a5a-b137-4b2c-8c1d-807ce910882c\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"450\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-calico"
Jun 29 17:10:38 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:38+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-calico\", UID:\"1bc03a5a-b137-4b2c-8c1d-807ce910882c\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"450\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-calico"
rke2.service日志
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-calico-crd\", UID:\"739e7d50-72a9-4df7-be44-469612248a49\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"428\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-calico-crd"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-cloud-provider\", UID:\"24ef6a53-f232-47ac-b946-a787675ad091\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"297\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-cloud-provider"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-coredns\", UID:\"a66f86d8-7945-4714-999a-1296db8f85e4\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"492\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-coredns"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-cloud-provider\", UID:\"24ef6a53-f232-47ac-b946-a787675ad091\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"297\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-cloud-provider"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-csi-driver\", UID:\"03a6be92-4ef4-46b2-8a43-5f7e4318f66f\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"306\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-csi-driver"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-coredns\", UID:\"a66f86d8-7945-4714-999a-1296db8f85e4\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"492\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-coredns"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-csi-driver\", UID:\"03a6be92-4ef4-46b2-8a43-5f7e4318f66f\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"306\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-csi-driver"
Jun 29 17:10:09 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:09+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"harvester-csi-driver\", UID:\"03a6be92-4ef4-46b2-8a43-5f7e4318f66f\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"306\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-harvester-csi-driver"
Jun 29 17:10:38 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:38+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-calico\", UID:\"1bc03a5a-b137-4b2c-8c1d-807ce910882c\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"450\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-calico"
Jun 29 17:10:38 rke2-focal1-pool2-30e4c599-k4s2w rke2[2391]: time="2022-06-29T17:10:38+08:00" level=info msg="Event(v1.ObjectReference{Kind:\"HelmChart\", Namespace:\"kube-system\", Name:\"rke2-calico\", UID:\"1bc03a5a-b137-4b2c-8c1d-807ce910882c\", APIVersion:\"helm.cattle.io/v1\", ResourceVersion:\"450\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyJob' Applying HelmChart using Job kube-system/helm-install-rke2-calico"

kubectl.log日志
E0629 18:15:27.911676    2571 kubelet.go:2376] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized"
E0629 18:15:28.124090    2571 dns.go:157] "Nameserver limits exceeded" err="Nameserver limits were exceeded, some nameservers have been omitted, the applied nameserver line is: 223.5.5.5 223.6.6.6 222.199.255.100"