异常问题求助:rancher单节点安装后 ,导入已有 的k8s集群,出现大量helm-operation-*类型 的pod,启动后停止。这类pod每隔几分钟就启动一个新的,刚启动的也是running,新的 启动后旧的pod就 error了

image
这类pod启动后是running,然后隔几分钟后就error了 然后 又会启动 一个新的。
kubectl describe pod内容:
Name: helm-operation-j5fxr
Namespace: cattle-system
Priority: 0
Service Account: default
Node: k8s-worker-01/192.168.88.211
Start Time: Sun, 29 Dec 2024 19:38:24 +0800
Labels: pod-impersonation.cattle.io/token=bzl28hzvtvnc4fnkkv65lrbtbdtbhphkptwrkb4v96zvtpdk2mr7tl
Annotations: cni.projectcalico.org/containerID: 5d456f188842c5ba030f88b4010ac43e4c7598fb00249c4172f623066704fb8b
cni.projectcalico.org/podIP: 10.244.36.205/32
cni.projectcalico.org/podIPs: 10.244.36.205/32
pod-impersonation.cattle.io/cluster-role: pod-impersonation-helm-op-jmxkd
Status: Running
IP: 10.244.36.205
IPs:
IP: 10.244.36.205
Containers:
helm:
Container ID: docker://7dc51fe677cf742cbc3ab30047505d8ada23e93dfdd42ee07b597e20a2502dee
Image: rancher/shell:v0.1.23
Image ID: docker-pullable://rancher/shell@sha256:5f8ed4770080893bd7a03d8627acfa476d7c4b8d10f533bdf32cfaf059bc85a4
Port:
Host Port:
Command:
helm-cmd
State: Terminated
Reason: Error
Exit Code: 1
Started: Sun, 29 Dec 2024 19:38:28 +0800
Finished: Sun, 29 Dec 2024 19:42:39 +0800
Ready: False
Restart Count: 0
Environment:
KUBECONFIG: /home/shell/.kube/config
Mounts:
/home/shell/.kube/config from user-kubeconfig (ro,path=“config”)
/home/shell/helm from data (ro)
proxy:
Container ID: docker://b201fa8df1ba770362e183f34b27473ffd532718ad84dd80ea36563da3b4614e
Image: rancher/shell:v0.1.23
Image ID: docker-pullable://rancher/shell@sha256:5f8ed4770080893bd7a03d8627acfa476d7c4b8d10f533bdf32cfaf059bc85a4
Port:
Host Port:
Command:
sh
-c
kubectl proxy --disable-filter || true
State: Running
Started: Sun, 29 Dec 2024 19:38:28 +0800
Ready: True
Restart Count: 0
Environment:
KUBECONFIG: /root/.kube/config
Mounts:
/root/.kube/config from admin-kubeconfig (ro,path=“config”)
/var/run/secrets/kubernetes.io/serviceaccount from pod-impersonation-helm-op-t749r-token (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
data:
Type: Secret (a volume populated by a Secret)
SecretName: helm-operation-4hd6b
Optional: false
admin-kubeconfig:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: impersonation-helm-op-admin-kubeconfig-7k752
Optional: false
user-kubeconfig:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: impersonation-helm-op-user-kubeconfig-vh4kl
Optional: false
pod-impersonation-helm-op-t749r-token:
Type: Secret (a volume populated by a Secret)
SecretName: pod-impersonation-helm-op-t749r-token
Optional: false
QoS Class: BestEffort
Node-Selectors: kubernetes.io/os=linux
Tolerations: cattle.io/os=linux:NoSchedule
node-role.kubernetes.io/controlplane=true:NoSchedule
node-role.kubernetes.io/etcd=true:NoExecute
node.cloudprovider.kubernetes.io/uninitialized=true:NoSchedule
node.kubernetes.io/not-ready:NoExecute op=Exists for 20s
node.kubernetes.io/unreachable:NoExecute op=Exists for 20s
Events:
Type Reason Age From Message


Normal Scheduled 30m default-scheduler Successfully assigned cattle-system/helm-operation-j5fxr to k8s-worker-01
Warning FailedCreatePodSandBox 30m kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container “a40ab907b935e5d4bbe1a4a2e6b6b12f6717d91d7f9951a63390e47db9845e74” network for pod “helm-operation-j5fxr”: networkPlugin cni failed to set up pod “helm-operation-j5fxr_cattle-system” network: plugin type=“calico” failed (add): error adding host side routes for interface: cali6cff81048ba, error: route (Ifindex: 4377, Dst: 10.244.36.237/32, Scope: link) already exists for an interface other than ‘cali6cff81048ba’: route (Ifindex: 69, Dst: 10.244.36.237/32, Scope: link, Iface: cali1e5bd53f909)
Warning FailedCreatePodSandBox 30m kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container “259432dcb194054023c8b4aca185d6b7cadc2bbe70efa67839c1a32ea122f44e” network for pod “helm-operation-j5fxr”: networkPlugin cni failed to set up pod “helm-operation-j5fxr_cattle-system” network: plugin type=“calico” failed (add): error adding host side routes for interface: cali6cff81048ba, error: route (Ifindex: 4378, Dst: 10.244.36.238/32, Scope: link) already exists for an interface other than ‘cali6cff81048ba’: route (Ifindex: 70, Dst: 10.244.36.238/32, Scope: link, Iface: cali01906a0030e)
Normal SandboxChanged 30m (x3 over 30m) kubelet Pod sandbox changed, it will be killed and re-created.
Warning FailedCreatePodSandBox 30m kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to set up sandbox container “e87b7df9aa63ce1661cf031e0cef08deeb16467b5c22898425c4dbd4e42118f7” network for pod “helm-operation-j5fxr”: networkPlugin cni failed to set up pod “helm-operation-j5fxr_cattle-system” network: plugin type=“calico” failed (add): error adding host side routes for interface: cali6cff81048ba, error: route (Ifindex: 4379, Dst: 10.244.36.223/32, Scope: link) already exists for an interface other than ‘cali6cff81048ba’: route (Ifindex: 1741, Dst: 10.244.36.223/32, Scope: link, Iface: cali9f41ac16ea5)
Normal Pulled 30m kubelet Container image “rancher/shell:v0.1.23” already present on machine
Normal Created 30m kubelet Created container helm
Normal Started 30m kubelet Started container helm
Normal Pulled 30m kubelet Container image “rancher/shell:v0.1.23” already present on machine
Normal Created 30m kubelet Created container proxy
Normal Started 30m kubelet Started container proxy
rancher页面 没有任何的安装:
image

请求解决办法。

kubectl logs pod的日志 发现一直等待api但是实际这个api方向感觉也2没有 问题

看一下coredns有没有报错

看下你的 rancher 和 导入的 K8s 集群都是什么版本,是否满足支持矩阵要求,支持矩阵连接可以看 本论坛 右上角。