Rancher Server 设置
- Rancher 版本:2.14.2
- 安装选项 (Docker install/Helm Chart): Docker
- 如果是 Helm Chart 安装,需要提供 Local 集群的类型(RKE1, RKE2, k3s, EKS, 等)和版本:
- 在线或离线部署:在线,国内
下游集群信息
- Kubernetes 版本:
- Cluster Type (Local/Downstream):
- 如果 Downstream,是什么类型的集群?(自定义/导入或为托管 等):
用户信息
- 登录用户的角色是什么? (管理员/集群所有者/集群成员/项目所有者/项目成员/自定义):
- 如果自定义,自定义权限集:
主机操作系统: rocky 9.6
docker版本: 29.5.3
问题描述: docker安装rancher2.14.2时,多个应用无法启动,rancher-turtles-controller-manager容器报if kind is a CRD, it should be installed before calling Start" err=“no matches for kind "Cluster" in version "cluster.x-k8s.io/v1beta2"” logger=“controller-runtime.source.Kind” kind="Cluster.cluster.x-k8s.io。使用2.14.1版本也是这个问题,请帮看下是什么原因,谢谢
重现步骤:
#配置默认仓库
mkdir -pv /etc/rancher/k3s
cat <<EOF > /etc/rancher/k3s/config.yaml
system-default-registry: registry.cn-hangzhou.aliyuncs.com
EOF
#启动rancher
docker run -d --restart=unless-stopped \
-p 80:80 -p 443:443 \
-v /var/lib/rancher:/var/lib/rancher \
-v /var/log/rancher/auditlog:/var/log/auditlog \
-v /etc/localtime:/etc/localtime:ro \
-v /etc/rancher/k3s/config.yaml:/etc/rancher/k3s/config.yaml \
--privileged \
-e CATTLE_SYSTEM_DEFAULT_REGISTRY=registry.cn-hangzhou.aliyuncs.com \
-e CATTLE_BOOTSTRAP_PASSWORD=rancher \
--name rancher \
registry.cn-hangzhou.aliyuncs.com/rancher/rancher:v2.14.2
结果:
sh-4.4# kubectl get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
cattle-fleet-system fleet-controller-7cc4664b8b-2gsx8 3/3 Running 6 (15m ago) 57m
cattle-fleet-system gitjob-65cff7dcd9-k56wh 1/1 Running 2 (15m ago) 57m
cattle-fleet-system helmops-585cf5d55c-8qm2v 1/1 Running 2 (15m ago) 57m
cattle-system api-extension-9dc4784f7-kvnwt 1/1 Running 1 (15m ago) 57m
cattle-system helm-operation-4gpmg 0/2 Error 0 58m
cattle-system helm-operation-8l6nn 0/2 Completed 0 57m
cattle-system helm-operation-f2ft4 0/2 Unknown 0 55m
cattle-system helm-operation-gl8rg 0/2 Unknown 0 57m
cattle-system helm-operation-s2fck 0/2 Unknown 0 54m
cattle-system helm-operation-srhtm 0/2 Error 0 59m
cattle-system helm-operation-tw48s 0/2 Unknown 0 56m
cattle-system rancher-webhook-647cfd6f-5g8lp 1/1 Running 2 (15m ago) 56m
cattle-system system-upgrade-controller-795675cc79-zf8t5 1/1 Running 1 (15m ago) 54m
cattle-turtles-system rancher-turtles-controller-manager-5b8fc5695c-cw28w 0/1 CrashLoopBackOff 12 (59s ago) 55m
kube-system coredns-85878d7698-65cjf 1/1 Running 4 (15m ago) 66m
sh-4.4#
sh-4.4#
sh-4.4# crictl images
WARN[0000] Config "/etc/crictl.yaml" does not exist, trying next: "/usr/bin/crictl.yaml"
WARN[0000] Image connect using default endpoints: [unix:///run/k3s/containerd/containerd.sock unix:///var/run/dockershim.sock unix:///run/containerd/containerd.sock unix:///run/crio/crio.sock unix:///var/run/cri-dockerd.sock]. As the default settings are now deprecated, you should set the endpoint instead.
IMAGE TAG IMAGE ID SIZE
registry.cn-hangzhou.aliyuncs.com/rancher/fleet v0.15.2 dd39ecc9fba13 110MB
registry.cn-hangzhou.aliyuncs.com/rancher/mirrored-coredns-coredns 1.14.2 38667dd9be96c 23.3MB
registry.cn-hangzhou.aliyuncs.com/rancher/mirrored-pause 3.6 6270bb605e12e 301kB
registry.cn-hangzhou.aliyuncs.com/rancher/rancher-webhook v0.10.6 919366f3a894b 22.3MB
registry.cn-hangzhou.aliyuncs.com/rancher/remotedialer-proxy v0.7.3 5a233ada9c0fe 18.4MB
registry.cn-hangzhou.aliyuncs.com/rancher/shell v0.7.0 48fbc8115d7f0 112MB
registry.cn-hangzhou.aliyuncs.com/rancher/system-upgrade-controller v0.19.1 7a9d26e5c22c8 14.6MB
registry.cn-hangzhou.aliyuncs.com/rancher/turtles v0.26.2 680cc9bee754d 33.8MB
预期结果:
截图:
其他上下文信息:
日志
#rancher-turtles-controller-manager日志
sh-4.4# kubectl logs -n cattle-turtles-system rancher-turtles-controller-manager-5b8fc5695c-cw28w
I0703 04:34:21.039409 1 main.go:234] "enabling Clusterctl Config synchronization controller" logger="setup"
I0703 04:34:21.039472 1 main.go:245] "enabling CAPI Operator synchronization controller" logger="setup"
I0703 04:34:21.046543 1 main.go:254] "enabling UI installation controller" logger="setup"
I0703 04:34:21.046563 1 main.go:176] "starting manager" logger="setup" version="v0.0.0-master+$Format:%H$"
I0703 04:34:21.046633 1 server.go:208] "Starting metrics server" logger="controller-runtime.metrics"
I0703 04:34:21.046655 1 server.go:83] "starting server" name="health probe" addr="[::]:9440"
I0703 04:34:21.046695 1 server.go:247] "Serving metrics server" logger="controller-runtime.metrics" bindAddress=":8080" secure=false
I0703 04:34:21.147056 1 leaderelection.go:257] attempting to acquire leader lease cattle-turtles-system/controller-leader-election-rancher-turtles...
I0703 04:34:38.748215 1 leaderelection.go:271] successfully acquired lease cattle-turtles-system/controller-leader-election-rancher-turtles
I0703 04:34:38.748572 1 controller.go:353] "Starting EventSource" controller="cluster" controllerGroup="cluster.x-k8s.io" controllerKind="Cluster" source="kind source: *v1.Namespace"
I0703 04:34:38.748673 1 controller.go:353] "Starting EventSource" controller="clusterctlconfig" controllerGroup="turtles-capi.cattle.io" controllerKind="ClusterctlConfig" source="kind source: *v1.ConfigMap"
I0703 04:34:38.748736 1 controller.go:353] "Starting EventSource" controller="cluster" controllerGroup="cluster.x-k8s.io" controllerKind="Cluster" source="kind source: *v1beta2.Cluster"
I0703 04:34:38.748772 1 controller.go:353] "Starting EventSource" controller="cluster" controllerGroup="cluster.x-k8s.io" controllerKind="Cluster" source="kind source: *v3.Cluster"
I0703 04:34:38.748843 1 controller.go:353] "Starting EventSource" controller="cleanup" controllerGroup="management.cattle.io" controllerKind="Cluster" source="kind source: *v3.Cluster"
I0703 04:34:38.748982 1 controller.go:353] "Starting EventSource" controller="healthcheck-turtles-capi.cattle.io/v1alpha1, Kind=CAPIProvider" controllerGroup="apps" controllerKind="Deployment" source="kind source: *v1alpha1.CAPIProvider"
I0703 04:34:38.749038 1 controller.go:353] "Starting EventSource" controller="clusterctlconfig" controllerGroup="turtles-capi.cattle.io" controllerKind="ClusterctlConfig" source="kind source: *v1alpha1.ClusterctlConfig"
I0703 04:34:38.749321 1 controller.go:353] "Starting EventSource" controller="ProviderReconciler" controllerGroup="turtles-capi.cattle.io" controllerKind="CAPIProvider" source="kind source: *v1alpha1.CAPIProvider"
I0703 04:34:38.749370 1 controller.go:353] "Starting EventSource" controller="healthcheck-turtles-capi.cattle.io/v1alpha1, Kind=CAPIProvider" controllerGroup="apps" controllerKind="Deployment" source="kind source: *v1.Deployment"
I0703 04:34:38.749414 1 controller.go:353] "Starting EventSource" controller="ProviderReconciler" controllerGroup="turtles-capi.cattle.io" controllerKind="CAPIProvider" source="kind source: *v1alpha1.CAPIProvider"
I0703 04:34:38.749420 1 controller.go:353] "Starting EventSource" controller="ProviderReconciler" controllerGroup="turtles-capi.cattle.io" controllerKind="CAPIProvider" source="kind source: *v1.Secret"
E0703 04:34:38.752995 1 kind.go:75] "if kind is a CRD, it should be installed before calling Start" err="no matches for kind \"Cluster\" in version \"cluster.x-k8s.io/v1beta2\"" logger="controller-runtime.source.Kind" kind="Cluster.cluster.x-k8s.io"
I0703 04:34:38.849405 1 controller.go:286] "Starting Controller" controller="clusterctlconfig" controllerGroup="turtles-capi.cattle.io" controllerKind="ClusterctlConfig"
I0703 04:34:38.849456 1 controller.go:289] "Starting workers" controller="clusterctlconfig" controllerGroup="turtles-capi.cattle.io" controllerKind="ClusterctlConfig" worker count=1
I0703 04:34:38.849497 1 controller.go:286] "Starting Controller" controller="cleanup" controllerGroup="management.cattle.io" controllerKind="Cluster"
I0703 04:34:38.849503 1 controller.go:289] "Starting workers" controller="cleanup" controllerGroup="management.cattle.io" controllerKind="Cluster" worker count=1
I0703 04:34:38.851244 1 config.go:152] "Turtles configured to use Rancher default registry for images" controller="clusterctlconfig" controllerGroup="turtles-capi.cattle.io" controllerKind="ClusterctlConfig" ClusterctlConfig="cattle-turtles-system/clusterctl-config" namespace="cattle-turtles-system" name="clusterctl-config" reconcileID="4b275bab-3d98-4c83-9b22-873a501825fb"
I0703 04:34:38.952257 1 config.go:162] "Rancher default registry has been set" controller="clusterctlconfig" controllerGroup="turtles-capi.cattle.io" controllerKind="ClusterctlConfig" ClusterctlConfig="cattle-turtles-system/clusterctl-config" namespace="cattle-turtles-system" name="clusterctl-config" reconcileID="4b275bab-3d98-4c83-9b22-873a501825fb" registry="registry.cn-hangzhou.aliyuncs.com"
I0703 04:34:38.952291 1 config.go:177] "Overridden provider image to use Rancher default registry" controller="clusterctlconfig" controllerGroup="turtles-capi.cattle.io" controllerKind="ClusterctlConfig" ClusterctlConfig="cattle-turtles-system/clusterctl-config" namespace="cattle-turtles-system" name="clusterctl-config" reconcileID="4b275bab-3d98-4c83-9b22-873a501825fb" image="cluster-api" repository="registry.cn-hangzhou.aliyuncs.com/rancher" tag=""
I0703 04:34:38.954487 1 controller.go:286] "Starting Controller" controller="ProviderReconciler" controllerGroup="turtles-capi.cattle.io" controllerKind="CAPIProvider"
I0703 04:34:38.954505 1 controller.go:289] "Starting workers" controller="ProviderReconciler" controllerGroup="turtles-capi.cattle.io" controllerKind="CAPIProvider" worker count=1
I0703 04:34:38.956521 1 controller.go:286] "Starting Controller" controller="healthcheck-turtles-capi.cattle.io/v1alpha1, Kind=CAPIProvider" controllerGroup="apps" controllerKind="Deployment"
I0703 04:34:38.956537 1 controller.go:289] "Starting workers" controller="healthcheck-turtles-capi.cattle.io/v1alpha1, Kind=CAPIProvider" controllerGroup="apps" controllerKind="Deployment" worker count=1
E0703 04:34:48.751214 1 kind.go:75] "if kind is a CRD, it should be installed before calling Start" err="no matches for kind \"Cluster\" in version \"cluster.x-k8s.io/v1beta2\"" logger="controller-runtime.source.Kind" kind="Cluster.cluster.x-k8s.io"
E0703 04:34:58.751095 1 kind.go:75] "if kind is a CRD, it should be installed before calling Start" err="no matches for kind \"Cluster\" in version \"cluster.x-k8s.io/v1beta2\"" logger="controller-runtime.source.Kind" kind="Cluster.cluster.x-k8s.io"
E0703 04:35:08.750490 1 kind.go:75] "if kind is a CRD, it should be installed before calling Start" err="no matches for kind \"Cluster\" in version \"cluster.x-k8s.io/v1beta2\"" logger="controller-runtime.source.Kind" kind="Cluster.cluster.x-k8s.io"
