自签名证书过期集群报错X509后，我集群是2.5.8的，安装官方文档：
步骤kubectl --insecure-skip-tls-verify -n kube-system delete secrets k3s-serving
kubectl --insecure-skip-tls-verify delete secret serving-cert -n cattle-system
rm -f /var/lib/rancher/k3s/server/tls/dynamic-cert.json
curl --insecure -sfL https://公网IP/v3 # 请将 替换为 Rancher Server 的访问地址
docker restart <rancher_server_id>
其中倒数第二步，我试了内网、域名、公网，我现在日志里面有个来历不明的IP
这个应该是 你注册节点时候使用的 IP
K神，请教下这个IP在哪修改
K神再帮忙分析下报错：
2023/05/14 16:46:49 [ERROR] error syncing ‘c-cp47s’: handler cluster-deploy: Get “https://192.168.0.1:443/apis/apps/v1/namespaces/cattle-system/daemonsets/cattle-node-agent”: waiting for cluster [c-cp47s] agent to connect, requeuing
E0514 16:46:49.587763 25 remote_runtime.go:113] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to reserve sandbox name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11”: name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11” is reserved for “514f79e63c9bf3b673cdddd0e3bee0b154183b9e21d21b575d0c8b43a55061ac”
E0514 16:46:49.587809 25 kuberuntime_sandbox.go:69] CreatePodSandbox for pod “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system(c321fe43-f1de-4b90-b064-44efb448a59d)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11”: name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11” is reserved for “514f79e63c9bf3b673cdddd0e3bee0b154183b9e21d21b575d0c8b43a55061ac”
E0514 16:46:49.587826 25 kuberuntime_manager.go:741] createPodSandbox for pod “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system(c321fe43-f1de-4b90-b064-44efb448a59d)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11”: name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11” is reserved for “514f79e63c9bf3b673cdddd0e3bee0b154183b9e21d21b575d0c8b43a55061ac”
E0514 16:46:49.587882 25 pod_workers.go:191] Error syncing pod c321fe43-f1de-4b90-b064-44efb448a59d (“rancher-operator-595ddc6db9-hqkx2_rancher-operator-system(c321fe43-f1de-4b90-b064-44efb448a59d)”), skipping: failed to “CreatePodSandbox” for “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system(c321fe43-f1de-4b90-b064-44efb448a59d)” with CreatePodSandboxError: “CreatePodSandbox for pod “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system(c321fe43-f1de-4b90-b064-44efb448a59d)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11”: name “rancher-operator-595ddc6db9-hqkx2_rancher-operator-system_c321fe43-f1de-4b90-b064-44efb448a59d_11” is reserved for “514f79e63c9bf3b673cdddd0e3bee0b154183b9e21d21b575d0c8b43a55061ac””
E0514 16:46:56.715147 25 remote_runtime.go:113] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11”: name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11” is reserved for “0c33c6c1e2d42b18b83de6c0a4e5a2c4e5ba99267fbadf8264752b6fcbdce254”
E0514 16:46:56.715195 25 kuberuntime_sandbox.go:69] CreatePodSandbox for pod “fleet-agent-d59db746-fpjzj_fleet-system(3b90b115-d712-4998-8454-c5d9df028865)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11”: name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11” is reserved for “0c33c6c1e2d42b18b83de6c0a4e5a2c4e5ba99267fbadf8264752b6fcbdce254”
E0514 16:46:56.715209 25 kuberuntime_manager.go:741] createPodSandbox for pod “fleet-agent-d59db746-fpjzj_fleet-system(3b90b115-d712-4998-8454-c5d9df028865)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11”: name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11” is reserved for “0c33c6c1e2d42b18b83de6c0a4e5a2c4e5ba99267fbadf8264752b6fcbdce254”
E0514 16:46:56.715263 25 pod_workers.go:191] Error syncing pod 3b90b115-d712-4998-8454-c5d9df028865 (“fleet-agent-d59db746-fpjzj_fleet-system(3b90b115-d712-4998-8454-c5d9df028865)”), skipping: failed to “CreatePodSandbox” for “fleet-agent-d59db746-fpjzj_fleet-system(3b90b115-d712-4998-8454-c5d9df028865)” with CreatePodSandboxError: "CreatePodSandbox for pod “fleet-agent-d59db746-fpjzj_fleet-system(3b90b115-d712-4998-8454-c5d9df028865)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11”: name “fleet-agent-d59db746-fpjzj_fleet-system_3b90b115-d712-4998-8454-c5d9df028865_11” is reserved for “0c33c6c1e2d42b18b83de6c0a4e5a2c4e5ba99267fbadf8264752b6fcbdce254"”
E0514 16:46:56.722854 25 remote_runtime.go:113] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to reserve sandbox name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11”: name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11” is reserved for “488ba18e5d560eb6dce0d3b73c1de144dd20f7c122972877128c9c513ab02647”
E0514 16:46:56.722904 25 kuberuntime_sandbox.go:69] CreatePodSandbox for pod “gitjob-568c57cfb9-6nql2_fleet-system(0814659e-9f66-4e95-9ff1-971e393ac953)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11”: name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11” is reserved for “488ba18e5d560eb6dce0d3b73c1de144dd20f7c122972877128c9c513ab02647”
E0514 16:46:56.722919 25 kuberuntime_manager.go:741] createPodSandbox for pod “gitjob-568c57cfb9-6nql2_fleet-system(0814659e-9f66-4e95-9ff1-971e393ac953)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11”: name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11” is reserved for “488ba18e5d560eb6dce0d3b73c1de144dd20f7c122972877128c9c513ab02647”
E0514 16:46:56.722971 25 pod_workers.go:191] Error syncing pod 0814659e-9f66-4e95-9ff1-971e393ac953 (“gitjob-568c57cfb9-6nql2_fleet-system(0814659e-9f66-4e95-9ff1-971e393ac953)”), skipping: failed to “CreatePodSandbox” for “gitjob-568c57cfb9-6nql2_fleet-system(0814659e-9f66-4e95-9ff1-971e393ac953)” with CreatePodSandboxError: "CreatePodSandbox for pod “gitjob-568c57cfb9-6nql2_fleet-system(0814659e-9f66-4e95-9ff1-971e393ac953)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11”: name “gitjob-568c57cfb9-6nql2_fleet-system_0814659e-9f66-4e95-9ff1-971e393ac953_11” is reserved for “488ba18e5d560eb6dce0d3b73c1de144dd20f7c122972877128c9c513ab02647"”
E0514 16:46:56.726904 25 remote_runtime.go:113] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to reserve sandbox name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11”: name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11” is reserved for “9cba7df2bf91eb71d767b89767c79d4829cfa5673b1ad588437f88b8d444d644”
E0514 16:46:56.726946 25 kuberuntime_sandbox.go:69] CreatePodSandbox for pod “coredns-66c464876b-9wgnk_kube-system(511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11”: name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11” is reserved for “9cba7df2bf91eb71d767b89767c79d4829cfa5673b1ad588437f88b8d444d644”
E0514 16:46:56.726962 25 kuberuntime_manager.go:741] createPodSandbox for pod “coredns-66c464876b-9wgnk_kube-system(511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11”: name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11” is reserved for “9cba7df2bf91eb71d767b89767c79d4829cfa5673b1ad588437f88b8d444d644”
E0514 16:46:56.727020 25 pod_workers.go:191] Error syncing pod 511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e (“coredns-66c464876b-9wgnk_kube-system(511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e)”), skipping: failed to “CreatePodSandbox” for “coredns-66c464876b-9wgnk_kube-system(511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e)” with CreatePodSandboxError: "CreatePodSandbox for pod “coredns-66c464876b-9wgnk_kube-system(511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11”: name “coredns-66c464876b-9wgnk_kube-system_511fb2c9-8bf3-4eab-aecb-c79d9d7cfb0e_11” is reserved for “9cba7df2bf91eb71d767b89767c79d4829cfa5673b1ad588437f88b8d444d644"”
E0514 16:46:58.614592 25 remote_runtime.go:113] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11”: name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11” is reserved for “45b6afc82b387153544150bbd3edb438e20d71c55319b9c2408e2154d1fb9dce”
E0514 16:46:58.614637 25 kuberuntime_sandbox.go:69] CreatePodSandbox for pod “fleet-controller-79554fcbf5-bjzpw_fleet-system(eed5a797-6958-4a47-b73f-53dd747e048c)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11”: name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11” is reserved for “45b6afc82b387153544150bbd3edb438e20d71c55319b9c2408e2154d1fb9dce”
E0514 16:46:58.614652 25 kuberuntime_manager.go:741] createPodSandbox for pod “fleet-controller-79554fcbf5-bjzpw_fleet-system(eed5a797-6958-4a47-b73f-53dd747e048c)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11”: name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11” is reserved for “45b6afc82b387153544150bbd3edb438e20d71c55319b9c2408e2154d1fb9dce”
E0514 16:46:58.614710 25 pod_workers.go:191] Error syncing pod eed5a797-6958-4a47-b73f-53dd747e048c (“fleet-controller-79554fcbf5-bjzpw_fleet-system(eed5a797-6958-4a47-b73f-53dd747e048c)”), skipping: failed to “CreatePodSandbox” for “fleet-controller-79554fcbf5-bjzpw_fleet-system(eed5a797-6958-4a47-b73f-53dd747e048c)” with CreatePodSandboxError: “CreatePodSandbox for pod “fleet-controller-79554fcbf5-bjzpw_fleet-system(eed5a797-6958-4a47-b73f-53dd747e048c)” failed: rpc error: code = Unknown desc = failed to reserve sandbox name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11”: name “fleet-controller-79554fcbf5-bjzpw_fleet-system_eed5a797-6958-4a47-b73f-53dd747e048c_11” is reserved for “45b6afc82b387153544150bbd3edb438e20d71c55319b9c2408e2154d1fb9dce””
E0514 16:47:01.548819 25 remote_runtime.go:140] StopPodSandbox “4cc6109f63f8c8e48de2c911d6f3000b1b7161f25a7fa13ea346b95186e060c0” from runtime service failed: rpc error: code = NotFound desc = an error occurred when try to find sandbox “4cc6109f63f8c8e48de2c911d6f3000b1b7161f25a7fa13ea346b95186e060c0”: not found
E0514 16:47:01.548858 25 kuberuntime_manager.go:909] Failed to stop sandbox {“containerd” “4cc6109f63f8c8e48de2c911d6f3000b1b7161f25a7fa13ea346b95186e060c0”}
E0514 16:47:01.548904 25 kuberuntime_manager.go:688] killPodWithSyncResult failed: failed to “KillPodSandbox” for “295262ef-c977-4fda-8436-680b5667387e” with KillPodSandboxError: “rpc error: code = NotFound desc = an error occurred when try to find sandbox “4cc6109f63f8c8e48de2c911d6f3000b1b7161f25a7fa13ea346b95186e060c0”: not found”
E0514 16:47:01.548934 25 pod_workers.go:191] Error syncing pod 295262ef-c977-4fda-8436-680b5667387e (“rancher-webhook-65f558c486-75kfl_cattle-system(295262ef-c977-4fda-8436-680b5667387e)”), skipping: failed to “KillPodSandbox” for “295262ef-c977-4fda-8436-680b5667387e” with KillPodSandboxError: “rpc error: code = NotFound desc = an error occurred when try to find sandbox “4cc6109f63f8c8e48de2c911d6f3000b1b7161f25a7fa13ea346b95186e060c0”: not found”
你可能得看下游集群的 cluster-agent 日志
