VM中某块盘无法使用

现象

VM中有一块盘，进入mount点后，ls显示错误：

[root@es10 data2]# ls
ls: cannot open directory .: Input/output error

跟踪分析

• 查看磁盘

[root@es10 ~]# lsblk | grep vdc
NAME   MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
vdc    253:32   0    2T  0 disk 
└─vdc1 253:33   0    2T  0 part /data2

• 查看mount情况

[root@es10 ~]# mount | grep vdc
/dev/vdc1 on /data2 type xfs (rw,relatime,attr2,inode64,noquota)

• 查看磁盘使用情况

[root@es10 data2]# df -h | grep vdc
Filesystem      Size  Used Avail Use% Mounted on
/dev/vdc1       2.0T  281G  1.7T  15% /data2

• 查看内存使用情况

[root@es10 ~]# free -h
              total        used        free      shared  buff/cache   available
Mem:            31G        322M         18G         16M         12G         30G
Swap:            0B          0B          0B

• 查看系统log

[root@es10 ~]# tail /var/log/messages
Dec  4 10:02:37 es10 kernel: XFS (vdc1): xfs_log_force: error -5 returned.
Dec  4 10:02:39 es10 kernel: XFS (vdc1): xfs_log_force: error -5 returned.
Dec  4 10:02:39 es10 kernel: XFS (vdc1): xfs_log_force: error -5 returned.

• 查看mount点被哪些进程使用

[root@es10 ~]# lsof | grep "/data2"
lsof: WARNING: can't stat() xfs file system /data2
      Output information may be incomplete.

[root@es10 ~]# lsof | grep "/data"
lsof: WARNING: can't stat() xfs file system /data2
      Output information may be incomplete.
bash      32147        root  cwd       DIR             253,17        26        128 /data1

解决

在网上搜索了一下，有人也遇到过，重新mount可以解决：

[root@es10 ~]# umount /data2
[root@es10 ~]# mount | grep vdc
[root@es10 ~]# mount /dev/vdc1 /data2

[root@es10 ~]# tail /var/log/messages