Microk8s 1.18 Change default host path storage location

Hi all, I want to use my usb drive as default storage location. I set the usb drive mount point to /mnt/microk8s_usb. I followed this https://github.com/ubuntu/microk8s/issues/463#issuecomment-491285745 to change /var/snap/microk8s/current/args/containerd as follow:

--config ${SNAP_DATA}/args/containerd.toml
--root /mnt/microk8s_usb/var/lib/containerd
--state /mnt/microk8s_usb/run/containerd
--address ${SNAP_COMMON}/run/containerd.sock

After restarted Microk8s, pods status are always ContainerCreating, but the node is on Ready state When I describe the pods, it shows the following message:

Warning  FailedCreatePodSandBox  2m54s (x17 over 6m41s)  kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container: failed to create containerd task: failed to mount rootfs component &{overlay overlay [workdir=/mnt/microk8s_usb/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/152/work upperdir=/mnt/microk8s_usb/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/152/fs lowerdir=/mnt/microk8s_usb/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs/snapshots/1/fs]}: invalid argument: unknown

Am I did something wrong? Thank you. inspection-report-20210131_070151.tar.gz

[skol101]

Is there a way to change not only the path but actually type of storage? Because hostPath isn’t support by Velero backup.

[jinjin123]

version: ubuntu22.04 change host path happen error… same partition with the old disk

Jul 6 18:46:42 jin microk8s.daemon-containerd[19905]: + exec /snap/microk8s/3272/bin/containerd --config /var/snap/microk8s/3272/args/containerd.toml --address /var/snap/microk8s/common/run/containerd.sock --root /mnt/raid1/microk8s/var/lib/containerd --state /mnt/raid1/microk8s/run/containerd

Jul 6 18:46:42 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:42.996927642+08:00” level=info msg=“starting containerd” revision=3df54a852345ae127d1fa3092b95168e4a88e2f8 version=v1.5.11 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.052813404+08:00” level=info msg=“loading plugin "io.containerd.content.v1.content"…” type=io.containerd.content.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.052931882+08:00” level=info msg=“loading plugin "io.containerd.snapshotter.v1.aufs"…” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.055696445+08:00” level=info msg=“skip loading plugin "io.containerd.snapshotter.v1.aufs"…” error=“aufs is not supported (modprobe aufs failed: exit status 1 "modprobe: FATAL: Module aufs not found in directory /lib/modules/5.15.0-39-generic\n"): skip plugin” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.055774026+08:00” level=info msg=“loading plugin "io.containerd.snapshotter.v1.btrfs"…” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.056245366+08:00” level=info msg=“skip loading plugin "io.containerd.snapshotter.v1.btrfs"…” error=“path /mnt/raid1/microk8s/var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.056294506+08:00” level=info msg=“loading plugin "io.containerd.snapshotter.v1.devmapper"…” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.056349049+08:00” level=warning msg=“failed to load plugin io.containerd.snapshotter.v1.devmapper” error=“devmapper not configured” Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.056376198+08:00” level=info msg=“loading plugin "io.containerd.snapshotter.v1.native"…” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.056429905+08:00” level=info msg=“loading plugin "io.containerd.snapshotter.v1.overlayfs"…” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.056671386+08:00” level=info msg=“loading plugin "io.containerd.snapshotter.v1.zfs"…” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.057108948+08:00” level=info msg=“skip loading plugin "io.containerd.snapshotter.v1.zfs"…” error=“path /mnt/raid1/microk8s/var/lib/containerd/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin” type=io.containerd.snapshotter.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.057158042+08:00” level=info msg=“loading plugin "io.containerd.metadata.v1.bolt"…” type=io.containerd.metadata.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.057196126+08:00” level=warning msg=“could not use snapshotter devmapper in metadata plugin” error=“devmapper not configured” Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.057221884+08:00” level=info msg=“metadata content store policy set” policy=shared Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.057455420+08:00” level=info msg=“loading plugin "io.containerd.differ.v1.walking"…” type=io.containerd.differ.v1 Jul 6 18:46:43 jin microk8s.daemon-containerd[19905]: time=“2022-07-06T18:46:43.057502121+08:00” level=info msg=“loading plugin "io.containerd.gc.v1.scheduler"…” type=io.containerd.gc.v1