K3s 新增节点,守护进程 longhorn-csi-plugin 一直启动失败

环境信息:
K3s 版本: k3s -v
k3s version v1.19.9+k3s1 (bead080d)

节点 CPU 架构、操作系统和版本::

Linux shk3s-m5 4.15.0-142-generic #146~16.04.1-Ubuntu SMP Tue Apr 13 09:27:15 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

集群配置:

问题描述:

复现步骤:

  • 安装 K3s 的命令:
    sudo ./k3s-install.sh

预期结果:

实际结果:

附加上下文/日志:

日志
![image|690x210](upload://oT9kE1dTOyYzpGfrXYlYQWjHzPA.png)
pod 条件

状态 	状态 	更新 	信息 
ContainersReady	True	0 secs ago	—
Initialized	True	2.6 小时 ago	—
PodScheduled	True	2.6 小时 ago	—
Ready	True	0 secs ago	—


![image|690x272](upload://lutCKQfNxIGRhkrLNYrPvnxOHx.png)
pod 日志
W0810 07:45:17.187936 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:45:27.187381 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:45:37.187326 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:45:47.187379 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:45:57.187698 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:46:07.188085 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:46:17.187232 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:46:27.187543 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:46:37.188043 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:46:47.187581 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:46:57.187631 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:47:07.187355 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:47:17.187006 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:47:27.187972 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:47:37.188045 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:47:47.187392 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:47:57.187767 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:48:07.187545 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:48:17.187563 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:48:27.187307 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:48:37.187406 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:48:47.187041 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:48:57.187674 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:49:07.187838 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:49:17.187325 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:49:27.187816 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:49:37.187647 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:49:47.187320 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:49:57.187413 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:50:07.187155 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:50:17.187377 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:50:27.187062 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:50:37.187200 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:50:47.187535 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:50:57.187872 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:51:07.187132 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:51:17.187049 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:51:27.188045 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:51:37.187845 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:51:47.187155 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:51:57.187218 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:52:07.187244 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:52:17.187502 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:52:27.187514 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:52:37.187607 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:52:47.187986 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:52:57.187168 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:53:07.187768 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:53:17.187230 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:53:27.187482 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:53:37.187482 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:53:47.187472 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:53:57.187568 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:54:07.187780 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:54:17.187755 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:54:27.187037 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:54:37.187132 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:54:47.187296 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:54:57.187078 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:55:07.187229 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:55:17.187369 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:55:27.187124 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:55:37.187188 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:55:47.187526 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:55:57.187024 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:56:07.187906 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:56:17.187546 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:56:27.187977 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:56:37.187942 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:56:47.188004 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:56:57.187440 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:57:07.187655 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:57:17.187115 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:57:27.187983 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:57:37.187413 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:57:47.187090 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:57:57.187111 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:58:07.188002 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:58:17.188017 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:58:27.187197 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:58:37.187632 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:58:47.187502 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:58:57.187099 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:59:07.187161 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:59:17.187518 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:59:27.187047 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:59:37.188030 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:59:47.188022 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 07:59:57.187144 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:00:07.187309 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:00:17.187834 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:00:27.187172 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:00:37.187772 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:00:47.187157 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:00:57.187746 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:01:07.187470 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:01:17.187095 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:01:27.188081 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:01:37.187739 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:01:47.187165 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:01:57.187614 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:02:07.187502 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:02:17.188027 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:02:27.187576 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:02:37.187383 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:02:47.187207 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:02:57.187965 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:03:07.187550 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:03:17.187391 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:03:27.187655 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:03:37.187757 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:03:47.187317 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:03:57.188017 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:04:07.187431 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:04:17.187033 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:04:27.187684 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:04:37.187406 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:04:47.188067 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:04:57.188007 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:05:07.187477 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:05:17.187495 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:05:27.187598 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:05:37.187179 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:05:47.187419 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:05:57.187498 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:06:07.187573 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:06:17.187049 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:06:27.187431 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:06:37.187623 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:06:47.187173 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:06:57.187042 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:07:07.188085 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:07:17.187415 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:07:27.188010 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:07:37.187981 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:07:47.187629 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:07:57.187533 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:08:07.187903 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:08:17.187146 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:08:27.187826 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:08:37.187880 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:08:47.187667 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:08:57.187096 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:09:07.187931 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:09:17.187147 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:09:27.187617 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:09:37.187344 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:09:47.187497 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:09:57.187053 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:10:07.187632 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:10:17.187282 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:10:27.188024 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:10:37.187967 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:10:47.187562 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:10:57.187276 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:11:07.187459 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:11:17.188014 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:11:27.188031 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:11:37.187362 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:11:47.187382 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:11:57.187751 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:12:07.187729 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:12:17.187555 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:12:27.187322 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:12:37.187665 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:12:47.187384 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:12:57.187715 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:13:07.188077 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:13:17.187448 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:13:27.187055 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:13:37.187929 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:13:47.187662 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:13:57.187431 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:14:07.188030 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:14:17.187862 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:14:27.187313 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:14:37.187689 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:14:47.187395 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:14:57.187234 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:15:07.187295 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:15:17.187522 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:15:27.187609 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:15:37.187631 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:15:47.188007 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:15:57.187926 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:16:07.187337 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:16:17.187407 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:16:27.187398 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:16:37.187383 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:16:47.187820 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:16:57.187064 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:17:07.187845 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:17:17.187989 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:17:27.187227 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:17:37.187901 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:17:47.187594 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:17:57.188029 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:18:07.187654 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:18:17.188008 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:18:27.187326 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:18:37.187430 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:18:47.187791 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:18:57.187623 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:19:07.187320 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:19:17.187217 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:19:27.187423 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:19:37.187914 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:19:47.187814 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:19:57.187581 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:20:07.188013 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:20:17.187318 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:20:27.187604 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:20:37.187536 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:20:47.188043 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:20:57.187956 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:21:07.187244 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:21:17.187600 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:21:27.188015 16137 connection.go:173] Still connecting to unix:///csi/csi.sock
W0810 08:21:37.187858 16137 connection.go:173] Still connecting to unix:///csi/csi.sock

可以看下节点是否缺失某些插件 Longhorn | Documentation

从longhorn 应用的状态看 longhorn-admission-webhook 、longhorn-conversion-webhook、 longhorn-ui 三个deployment状态有异常,

通过 kubectl get pods -n longhorn-system 看到longhorn-system 空间的pod有异常,
对于deployment的应用,尝试通过删除pod会自动恢复,试了还是无效。
不知道该如何恢复了
I0818 11:23:16.394348 31927 request.go:645] Throttling request took 1.163103251s, request: GET:https://127.0.0.1:6443/apis/authentication.k8s.io/v1beta1?timeout=32s
I0818 11:23:26.594233 31927 request.go:645] Throttling request took 11.362924369s, request: GET:https://127.0.0.1:6443/apis/iam.kubesphere.io/v1alpha2?timeout=32s
NAME READY STATUS RESTARTS AGE
longhorn-csi-plugin-h4229 3/3 Running 3 65d
instance-manager-r-1d40a70b3c131015949afe768593e373 1/1 Running 0 11d
instance-manager-e-1d40a70b3c131015949afe768593e373 1/1 Running 0 11d
longhorn-csi-plugin-fcjw9 3/3 Running 4 51d
engine-image-ei-7d134615-d2t5l 1/1 Running 17 51d
instance-manager-r-84b6dfef94fc70226e75839af8340d47 1/1 Running 0 10d
longhorn-manager-zwt5j 1/1 Running 1 51d
instance-manager-e-84b6dfef94fc70226e75839af8340d47 1/1 Running 0 10d
csi-provisioner-5df8d49948-lwmj6 1/1 Running 0 9d
engine-image-ei-7d134615-vltgq 1/1 Running 9 65d
longhorn-manager-j5pmt 1/1 Running 5 65d
longhorn-csi-plugin-jpxg7 3/3 Running 0 9d
instance-manager-e-02eb553808eaf6737919c3dec5ae5db1 1/1 Running 0 9d
instance-manager-r-02eb553808eaf6737919c3dec5ae5db1 1/1 Running 0 9d
instance-manager-e-2b4ceccb2d676a40faa482acd7196082 1/1 Running 0 8d
instance-manager-r-2b4ceccb2d676a40faa482acd7196082 1/1 Running 0 8d
longhorn-csi-plugin-cpvhh 3/3 Running 0 8d
engine-image-ei-7d134615-nrjtm 1/1 Running 0 8d
longhorn-manager-dhd5j 1/1 Running 1 65d
longhorn-manager-njt49 1/1 Running 3 65d
longhorn-csi-plugin-pthck 3/3 Running 6 65d
instance-manager-e-81db5e0171d612780c3b1f3de412114f 1/1 Running 0 6d19h
instance-manager-r-81db5e0171d612780c3b1f3de412114f 1/1 Running 0 6d19h
engine-image-ei-7d134615-8vz6k 1/1 Running 688 65d
csi-snapshotter-5768bd46-s25c6 1/1 Running 2 9d
csi-attacher-6758687bf-wzk49 1/1 Running 0 6d4h
csi-resizer-6b7d679dcd-8rmrk 1/1 Running 0 6d4h
csi-provisioner-5df8d49948-6j7zj 1/1 Running 0 6d4h
longhorn-conversion-webhook-74664f9dcf-mq84f 1/1 Running 0 6d4h
longhorn-manager-87bq4 1/1 Running 1 65d
engine-image-ei-7d134615-bfhrm 1/1 Running 1 65d
longhorn-csi-plugin-mmhwq 3/3 Running 15 65d
instance-manager-e-a3886e386971c96083e73f5438fd0a16 1/1 Running 0 6d3h
instance-manager-r-a3886e386971c96083e73f5438fd0a16 1/1 Running 0 6d3h
csi-attacher-6758687bf-rnrxx 1/1 Running 0 4d2h
csi-snapshotter-5768bd46-tmd7r 1/1 Running 0 4d2h
csi-resizer-6b7d679dcd-kmnlk 1/1 Running 0 4d2h
c-bo85kg-1692201600-7spnb 0/1 Completed 0 35h
c-ax9t5l-1692201600-knqvt 0/1 Completed 0 35h
c-0lvcn5-1692201600-j2zmr 0/1 Completed 0 35h
longhorn-driver-deployer-6fbc589ccc-dsbck 1/1 Running 0 34h
engine-image-ei-7d134615-k47l7 0/1 Running 1 8d
longhorn-conversion-webhook-74664f9dcf-rpqtp 0/1 Pending 0 19h
longhorn-admission-webhook-855c4b945f-qh57t 0/1 Pending 0 12h
csi-snapshotter-5768bd46-mz498 0/1 Pending 0 12h
longhorn-ui-7cbbcfc67c-lg7ms 0/1 Pending 0 12h
c-bo85kg-1692288000-whdnv 0/1 Pending 0 11h
c-ax9t5l-1692288000-fvx5f 0/1 Pending 0 11h
c-wpjemx-1692288000-pkxm7 0/1 Pending 0 11h
c-hsepov-1692288000-gcghs 0/1 Pending 0 11h
c-0lvcn5-1692288000-tnhnx 0/1 Pending 0 11h
c-2icv5r-1692288000-jfs62 0/1 Pending 0 11h
c-o8r3zg-1692288000-s84z9 0/1 Pending 0 11h
c-ayul4m-1692288000-sk56t 0/1 Pending 0 11h
c-irrbyi-1692288000-w2psc 0/1 Pending 0 11h
c-r0t3wa-1692288000-p8qsz 0/1 Pending 0 11h
longhorn-manager-8h4h2 0/1 Init:0/1 1 20h
csi-attacher-6758687bf-wzzsv 1/1 Running 1641 6d19h
csi-provisioner-5df8d49948-d88g6 1/1 Running 1641 6d19h
engine-image-ei-7d134615-s7vx9 1/1 Running 7 7d21h
csi-resizer-6b7d679dcd-qk2pv 1/1 Running 1641 6d19h
engine-image-ei-7d134615-5nh4b 1/1 Running 0 65d
longhorn-csi-plugin-jqn2s 3/3 Running 1 65d
longhorn-manager-cjlht 1/1 Running 3 65d
instance-manager-e-f24ce6df986bb3f60ebef0b332b9353d 1/1 Running 0 12h
instance-manager-r-f24ce6df986bb3f60ebef0b332b9353d 1/1 Running 0 12h
longhorn-manager-mk8lj 1/1 Running 3 65d
longhorn-csi-plugin-dgg2g 3/3 Running 3953 65d
longhorn-manager-2pd76 0/1 Init:0/1 1 65d
engine-image-ei-7d134615-c6vkr 1/1 Running 1 65d
longhorn-admission-webhook-855c4b945f-5mcsk 0/1 Pending 0 45m
longhorn-ui-7cbbcfc67c-vhgld 0/1 CrashLoopBackOff 1093 4d2h
longhorn-csi-plugin-ckpxl 2/3 Error 3 20h

集群在十几天是好的,最近引入了两个节点【一个master和一个worker】后出现各种异常,

longhorn 是通过helm 部署的,没有做特别处理

重启后,问题修复。

#重启大法#治百病

1 个赞