kubelet Failed to create summary reader for none of the resourc es are being tracked.

kubelet启动完整日志如下

[root@abcdocker ~]# journalctl -fu kubelet
-- Logs begin at Wed 2022-11-16 10:56:15 CST. --
Nov 28 21:47:51 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:47:51.815971   23187 container.go:393] Failed to create summary reader for "/libcontainer_23584_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: E1128 21:47:52.080824   23187 remote_runtime.go:282] ContainerStatus "2e2b1ec4dd55003ae0fb7f7a24e9612b5c5b16d88f6a98340ffdece5c6ca3d3f" from runtime serv
ice failed: rpc error: code = Unknown desc = Error: No such container: 2e2b1ec4dd55003ae0fb7f7a24e9612b5c5b16d88f6a98340ffdece5c6ca3d3fNov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: E1128 21:47:52.081370   23187 remote_runtime.go:282] ContainerStatus "51a1c60210bd88a2cb16ea51b7ca371154e598daa78977b9b9f2febfbd71fc14" from runtime serv
ice failed: rpc error: code = Unknown desc = Error: No such container: 51a1c60210bd88a2cb16ea51b7ca371154e598daa78977b9b9f2febfbd71fc14Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: E1128 21:47:52.081936   23187 remote_runtime.go:282] ContainerStatus "3759b0efd2db7600357a84ee0075526f90c890fa652b51c7a7197b17ff147e37" from runtime serv
ice failed: rpc error: code = Unknown desc = Error: No such container: 3759b0efd2db7600357a84ee0075526f90c890fa652b51c7a7197b17ff147e37Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: I1128 21:47:52.169334   23187 reconciler.go:181] operationExecutor.UnmountVolume started for volume "default-token-247lj" (UniqueName: "kubernetes.io/sec
ret/7c7ee8e7-6f21-11ed-a025-00163e060604-default-token-247lj") pod "7c7ee8e7-6f21-11ed-a025-00163e060604" (UID: "7c7ee8e7-6f21-11ed-a025-00163e060604")Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: I1128 21:47:52.169399   23187 reconciler.go:181] operationExecutor.UnmountVolume started for volume "log" (UniqueName: "kubernetes.io/empty-dir/7c7ee8e7-
6f21-11ed-a025-00163e060604-log") pod "7c7ee8e7-6f21-11ed-a025-00163e060604" (UID: "7c7ee8e7-6f21-11ed-a025-00163e060604")Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: I1128 21:47:52.169651   23187 operation_generator.go:698] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c7ee8e7-6f21-11ed-a025-00
163e060604-log" (OuterVolumeSpecName: "log") pod "7c7ee8e7-6f21-11ed-a025-00163e060604" (UID: "7c7ee8e7-6f21-11ed-a025-00163e060604"). InnerVolumeSpecName "log". PluginName "kubernetes.io/empty-dir", VolumeGidValue ""Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: I1128 21:47:52.171825   23187 operation_generator.go:698] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c7ee8e7-6f21-11ed-a025-00163
e060604-default-token-247lj" (OuterVolumeSpecName: "default-token-247lj") pod "7c7ee8e7-6f21-11ed-a025-00163e060604" (UID: "7c7ee8e7-6f21-11ed-a025-00163e060604"). InnerVolumeSpecName "default-token-247lj". PluginName "kubernetes.io/secret", VolumeGidValue ""Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: I1128 21:47:52.269606   23187 reconciler.go:301] Volume detached for volume "default-token-247lj" (UniqueName: "kubernetes.io/secret/7c7ee8e7-6f21-11ed-a
025-00163e060604-default-token-247lj") on node "cn-beijing-zx-d01.i-el501lndxo5dkhmfls4j" DevicePath ""Nov 28 21:47:52 izel501lndxo5dkhmfls4jz kubelet[23187]: I1128 21:47:52.269646   23187 reconciler.go:301] Volume detached for volume "log" (UniqueName: "kubernetes.io/empty-dir/7c7ee8e7-6f21-11ed-a025-00163e060
604-log") on node "cn-beijing-zx-d01.i-el501lndxo5dkhmfls4j" DevicePath ""Nov 28 21:48:01 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:01.844584   23187 container.go:507] Failed to update stats for container "/libcontainer_23641_systemd_test_default.slice": read /sys/fs/cgrou
p/memory/libcontainer_23641_systemd_test_default.slice/memory.use_hierarchy: no such device, continuing to push statsNov 28 21:48:01 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:01.878055   23187 container.go:406] Failed to get RecentStats("/libcontainer_23647_systemd_test_default.slice") while determining the next ho
usekeeping: unable to find data in memory cacheNov 28 21:48:02 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:02.384877   23187 container.go:393] Failed to create summary reader for "/libcontainer_23682_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:02 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:02.385039   23187 container.go:393] Failed to create summary reader for "/libcontainer_23682_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:02 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:02.385174   23187 container.go:393] Failed to create summary reader for "/libcontainer_23688_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:02 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:02.385306   23187 container.go:393] Failed to create summary reader for "/libcontainer_23688_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:02 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:02.385438   23187 container.go:393] Failed to create summary reader for "/libcontainer_23695_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:02 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:02.385568   23187 container.go:393] Failed to create summary reader for "/libcontainer_23695_systemd_test_default.slice": none of the resourc
es are being tracked.
Nov 28 21:48:17 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:17.502966   23187 container.go:393] Failed to create summary reader for "/libcontainer_23809_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:17 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:17.503137   23187 container.go:393] Failed to create summary reader for "/libcontainer_23809_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:17 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:17.503272   23187 container.go:393] Failed to create summary reader for "/libcontainer_23815_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:17 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:17.503404   23187 container.go:393] Failed to create summary reader for "/libcontainer_23815_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:17 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:17.503531   23187 container.go:393] Failed to create summary reader for "/libcontainer_23821_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:17 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:17.503645   23187 container.go:393] Failed to create summary reader for "/libcontainer_23821_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:32 izel501lndxo5dkhmfls4jz kubelet[23187]: E1128 21:48:32.378554   23187 pod_workers.go:186] Error syncing pod b5b99fd0-6f22-11ed-a025-00163e060604 ("consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6
f22-11ed-a025-00163e060604)"), skipping: failed to "StartContainer" for "consolidation" with CrashLoopBackOff: "Back-off 10s restarting failed container=consolidation pod=consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6f22-11ed-a025-00163e060604)"Nov 28 21:48:45 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:45.995926   23187 container.go:406] Failed to get RecentStats("/libcontainer_24073_systemd_test_default.slice") while determining the next ho
usekeeping: unable to find data in memory cacheNov 28 21:48:46 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:46.174735   23187 container.go:393] Failed to create summary reader for "/libcontainer_24092_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:46 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:46.174990   23187 container.go:393] Failed to create summary reader for "/libcontainer_24092_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:46 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:46.175201   23187 container.go:393] Failed to create summary reader for "/libcontainer_24098_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:46 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:46.175411   23187 container.go:393] Failed to create summary reader for "/libcontainer_24098_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:46 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:46.175624   23187 container.go:393] Failed to create summary reader for "/libcontainer_24106_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:48:46 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:48:46.175840   23187 container.go:393] Failed to create summary reader for "/libcontainer_24106_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:49:00 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:00.780059   23187 container.go:507] Failed to update stats for container "/libcontainer_24235_systemd_test_default.slice": open /sys/fs/cgrou
p/memory/libcontainer_24235_systemd_test_default.slice/memory.use_hierarchy: no such file or directory, continuing to push statsNov 28 21:49:01 izel501lndxo5dkhmfls4jz kubelet[23187]: E1128 21:49:01.623515   23187 pod_workers.go:186] Error syncing pod b5b99fd0-6f22-11ed-a025-00163e060604 ("consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6
f22-11ed-a025-00163e060604)"), skipping: failed to "StartContainer" for "consolidation" with CrashLoopBackOff: "Back-off 20s restarting failed container=consolidation pod=consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6f22-11ed-a025-00163e060604)"Nov 28 21:49:13 izel501lndxo5dkhmfls4jz kubelet[23187]: E1128 21:49:13.913988   23187 pod_workers.go:186] Error syncing pod b5b99fd0-6f22-11ed-a025-00163e060604 ("consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6
f22-11ed-a025-00163e060604)"), skipping: failed to "StartContainer" for "consolidation" with CrashLoopBackOff: "Back-off 20s restarting failed container=consolidation pod=consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6f22-11ed-a025-00163e060604)"Nov 28 21:49:17 izel501lndxo5dkhmfls4jz kubelet[23187]: E1128 21:49:17.298901   23187 pod_workers.go:186] Error syncing pod b5b99fd0-6f22-11ed-a025-00163e060604 ("consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6
f22-11ed-a025-00163e060604)"), skipping: failed to "StartContainer" for "consolidation" with CrashLoopBackOff: "Back-off 20s restarting failed container=consolidation pod=consolidation-6db89fd549-5cwbz_hbbb(b5b99fd0-6f22-11ed-a025-00163e060604)"Nov 28 21:49:31 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:31.994671   23187 container.go:507] Failed to update stats for container "/libcontainer_24318_systemd_test_default.slice": failed to parse me
mory.kmem.limit_in_bytes - read /sys/fs/cgroup/memory/libcontainer_24318_systemd_test_default.slice/memory.kmem.limit_in_bytes: no such device, continuing to push statsNov 28 21:49:32 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:32.160018   23187 container.go:393] Failed to create summary reader for "/libcontainer_24335_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:49:32 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:32.160207   23187 container.go:393] Failed to create summary reader for "/libcontainer_24335_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:49:32 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:32.160370   23187 container.go:393] Failed to create summary reader for "/libcontainer_24341_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:49:32 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:32.160519   23187 container.go:393] Failed to create summary reader for "/libcontainer_24341_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:49:32 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:32.160659   23187 container.go:393] Failed to create summary reader for "/libcontainer_24348_systemd_test_default.slice": none of the resourc
es are being tracked.Nov 28 21:49:32 izel501lndxo5dkhmfls4jz kubelet[23187]: W1128 21:49:32.160791   23187 container.go:393] Failed to create summary reader for "/libcontainer_24348_systemd_test_default.slice": none of the resourc
es are being tracked.

解决方法:

mount -o remount,rw '/sys/fs/cgroup'
ln -s /sys/fs/cgroup/cpu,cpuacct /sys/fs/cgroup/cpuacct,cpu