Rancher Server 设置
- Rancher 版本：
- 安装选项 (Docker install/Helm Chart):
- 如果是 Helm Chart 安装，需要提供 Local 集群的类型（RKE1, RKE2, k3s, EKS, 等）和版本：
- 在线或离线部署：离线docker升级
下游集群信息
- Kubernetes 版本:
- Cluster Type (Local/Downstream):
- 如果 Downstream，是什么类型的集群?(自定义/导入或为托管 等):
用户信息
- 登录用户的角色是什么？ （管理员/集群所有者/集群成员/项目所有者/项目成员/自定义）：
- 如果自定义，自定义权限集：
问题描述：
重现步骤：
结果：
预期结果：
截图：
其他上下文信息：
日志
2022/07/20 13:32:06 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:06 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:06 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:06 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:08 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:08 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:09 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:09 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update clusters-create: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:10 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:10 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:11 [ERROR] Error during subscribe websocket: close sent
2022/07/20 13:32:14 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:14 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update clusters-create: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:15 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:15 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:19 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:19 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update clusters-create: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:24 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:24 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user-base: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:26 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:26 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:29 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:29 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update clusters-create: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:34 [ERROR] error syncing '_all_': handler user-controllers-controller: failed to start user controllers for cluster c-7crk6: ClusterUnavailable 503: cluster not found, requeuing
2022/07/20 13:32:34 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:35 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update roles-manage: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:40 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:40 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:45 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:45 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:46 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:46 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:32:50 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:50 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update roles-manage: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:32:55 [INFO] Reconciling GlobalRoles
2022/07/20 13:32:55 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user-base: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:00 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:00 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:04 [ERROR] error syncing '_all_': handler user-controllers-controller: failed to start user controllers for cluster c-7crk6: ClusterUnavailable 503: cluster not found, requeuing
2022/07/20 13:33:05 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:05 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:05 [ERROR] error syncing 'system-default-registry': handler fleet-install: pod cattle-system/helm-operation-7fhbw failed, watch closed, requeuing
2022/07/20 13:33:10 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:10 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update clusters-create: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:15 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:15 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:16 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:33:16 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:33:20 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:20 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:25 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:25 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update clusters-create: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:30 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:30 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:34 [ERROR] error syncing '_all_': handler user-controllers-controller: failed to start user controllers for cluster c-7crk6: ClusterUnavailable 503: cluster not found, requeuing
2022/07/20 13:33:35 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:35 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:41 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:41 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:46 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:46 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user-base: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:46 [ERROR] error syncing 'fleet-default/c-7crk6': handler cluster-create: failed to create c-7crk6/c-7crk6-fleet-default-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-default/c-7crk6: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:33:46 [ERROR] error syncing 'fleet-local/local': handler cluster-create: failed to create local/local-fleet-local-owner management.cattle.io/v3, Kind=ClusterRoleTemplateBinding for cluster-create fleet-local/local: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook", requeuing
2022/07/20 13:33:51 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:51 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:33:56 [INFO] Reconciling GlobalRoles
2022/07/20 13:33:56 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:34:01 [INFO] Reconciling GlobalRoles
2022/07/20 13:34:01 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update user: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:34:04 [ERROR] error syncing '_all_': handler user-controllers-controller: failed to start user controllers for cluster c-7crk6: ClusterUnavailable 503: cluster not found, requeuing
2022/07/20 13:34:05 [ERROR] error syncing 'cacerts': handler fleet-install: pod cattle-system/helm-operation-l7zxx failed, watch closed, requeuing
2022/07/20 13:34:06 [INFO] Reconciling GlobalRoles
2022/07/20 13:34:06 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update roles-manage: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"
2022/07/20 13:34:11 [INFO] Reconciling GlobalRoles
2022/07/20 13:34:11 [ERROR] failed to call leader func: failed to add management data: problem reconciling global roles: couldn't update restricted-admin: Internal error occurred: failed calling webhook "rancherauth.cattle.io": failed to call webhook: Post "https://rancher-webhook.cattle-system.svc:443/v1/webhook/validation?timeout=10s": no endpoints available for service "rancher-webhook"