pvs Error reading device /dev/xxx at 0 length 512.

背景：ceph osd 服务器磁盘坏掉，将坏掉的 osd 从集群中踢出后， pvs 报错. 系统 centos7，ceph luminous

1、查看错误信息

[root@cmp15 ~]# pvs
  Error reading device /dev/ceph-d6500029-3aca-4d5d-8ca1-581f4ea0c86c/osd-data-dfabf3a8-083d-4f76-8edc-318f2c156bf8 at 0 length 512.
  Error reading device /dev/ceph-d6500029-3aca-4d5d-8ca1-581f4ea0c86c/osd-data-dfabf3a8-083d-4f76-8edc-318f2c156bf8 at 0 length 4.
  Error reading device /dev/ceph-d6500029-3aca-4d5d-8ca1-581f4ea0c86c/osd-data-dfabf3a8-083d-4f76-8edc-318f2c156bf8 at 4096 length 4.
  PV         VG                                        Fmt  Attr PSize  PFree
  /dev/sdb   ceph-52b9da47-7768-4f21-b635-bbc87d01dcbe lvm2 a--  <1.64t    0 
  /dev/sdd   ceph-e7f46d1a-d2c1-43a5-bb0f-7703cf15a219 lvm2 a--  <1.64t    0 
...

2、查看 device-mapper 信息

[root@cmp15 ~]# dmsetup ls | grep 581f4ea0c86c
ceph--d6500029--3aca--4d5d--8ca1--581f4ea0c86c-osd--data--dfabf3a8--083d--4f76--8edc--318f2c156bf8	(253:10)

3、解决方法，清除过期的 device-mapper 信息

[root@cmp15 ~]# dmsetup remove /dev/ceph-d6500029-3aca-4d5d-8ca1-581f4ea0c86c/osd-data-dfabf3a8-083d-4f76-8edc-318f2c156bf8

[root@cmp15 ~]# pvs
  PV         VG                                        Fmt  Attr PSize  PFree
  /dev/sdb   ceph-52b9da47-7768-4f21-b635-bbc87d01dcbe lvm2 a--  <1.64t    0 
  /dev/sdd   ceph-e7f46d1a-d2c1-43a5-bb0f-7703cf15a219 lvm2 a--  <1.64t    0 
  /dev/sde   ceph-e8acea4c-2516-4744-b909-96a99d7c145e lvm2 a--  <1.64t    0 
  /dev/sdf   ceph-d587084c-bcd8-4178-9442-23cb88916d52 lvm2 a--  <1.64t    0 
  /dev/sdg   ceph-c4204b09-2733-469d-950b-e2abe9f6b6e4 lvm2 a--  <1.64t    0 
  /dev/sdh   ceph-d21c45dc-f0bc-45f7-90dc-5ac90b3473c4 lvm2 a--  <1.64t    0 
  /dev/sdi   ceph-4dcf3516-ce19-440d-a2d5-50f15cbcfd19 lvm2 a--  <1.64t    0 
  /dev/sdj   ceph-2225e6d0-e568-4a36-842d-4e39cc1db37d lvm2 a--  <1.64t    0 
  /dev/sdk   ceph-77d47d99-0048-415d-ba7d-4b1aaf0cfc55 lvm2 a--  <1.64t    0 
  /dev/sdl   ceph-8a179df9-2155-4874-9700-f00a9cfcaaa8 lvm2 a--  <1.64t    0 
  /dev/sdm   ceph-9bada194-6486-44cf-b072-d313b78cd214 lvm2 a--  <1.64t    0 
  /dev/sdn   ceph-2a1d39d5-c0f1-43db-8e73-9cbff4efbbc3 lvm2 a--  <1.64t    0 
  /dev/sdo   ceph-33f17176-7672-47a5-887d-5f9f154257ef lvm2 a--  <1.64t    0 
  /dev/sdp   ceph-73645490-ad25-4594-9b2a-ba812cc46a1b lvm2 a--  <1.64t    0 
  /dev/sdq   ceph-ca39777e-b924-442a-9f47-b27e302c675c lvm2 a--  <1.64t    0 
  /dev/sdr   ceph-9989166b-b870-4b0b-bb11-f443add1b8a3 lvm2 a--  <1.64t    0 
  /dev/sds   ceph-1e70a0cf-65fe-4a82-8ba6-f63917677a1f lvm2 a--  <1.64t    0 
  /dev/sdt   ceph-0a077b76-9908-494e-962a-dcdcfaa6da14 lvm2 a--  <1.64t    0 
  /dev/sdu   ceph-57954cf0-9db9-4712-a9fd-8e85667c90ae lvm2 a--  <1.64t    0 

参考文章：

https://access.redhat.com/solutions/140273