出现这种错误,根据Ceph Feature信息使用匹配的kernel,进行kernel升级。 ceph0.80.1 可以升级到kernel 3.14.12
Depending on the kernel version you may be missing some features required by the cluster (or vice versa, required by client but not available on the cluster). Hence the errors “feature set mismatch”.
Some examples of errors that can be encountered :
mon0 192.168.0.1:6789 feature set mismatch, my 4a042a42 < server's 84a042a42, missing 2040000
—> Upgrade kernel client up to 3.9 or set tunables to legacy : ceph osd crush tunables legacy
mon0 192.168.0.1:6789 feature set mismatch, my 4a042a42 < server's 84a042a42, missing 40000000
—> Upgrade kernel client up to 3.9 or unset hashpspool : ceph osd pool set rbd hashpspool false
mon0 192.168.0.1:6789 feature set mismatch, my 4a042a42 < server's 84a042a42, missing 800000000
—> Remove cache pool and reload monitors
CEPH_FEATURE Table and Kernel Version
You can find the feature missing in that table (HEX)
For exemple, missing 2040000
means that CEPH_FEATURE_CRUSH_TUNABLES (40000) and CEPH_FEATURE_CRUSH_TUNABLES2 (2000000) is missing on kernel client.
‘R’:required, ’S’:support
Feature | BIT | HEX | 3.8 | 3.9 | 3.10 | 3.11 | 3.12 |
---|---|---|---|---|---|---|---|
CEPH_FEATURE_UID | 0 | 1 | |||||
CEPH_FEATURE_NOSRCADDR | 1 | 2 | R | R | R | R | R |
CEPH_FEATURE_MONCLOCKCHECK | 2 | 4 | |||||
CEPH_FEATURE_FLOCK | 3 | 8 | |||||
CEPH_FEATURE_SUBSCRIBE2 | 4 | 10 | |||||
CEPH_FEATURE_MONNAMES | 5 | 20 | |||||
CEPH_FEATURE_RECONNECT_SEQ | 6 | 40 | R | R | R | ||
CEPH_FEATURE_DIRLAYOUTHASH | 7 | 80 | |||||
CEPH_FEATURE_OBJECTLOCATOR | 8 | 100 | |||||
CEPH_FEATURE_PGID64 | 9 | 200 | R | R | R | R | |
CEPH_FEATURE_INCSUBOSDMAP | 10 | 400 | |||||
CEPH_FEATURE_PGPOOL3 | 11 | 800 | R | R | R | R | |
CEPH_FEATURE_OSDREPLYMUX | 12 | 1000 | |||||
CEPH_FEATURE_OSDENC | 13 | 2000 | R | R | R | R | |
CEPH_FEATURE_OMAP | 14 | 4000 | |||||
CEPH_FEATURE_MONENC | 15 | 8000 | |||||
CEPH_FEATURE_QUERY_T | 16 | 10000 | |||||
CEPH_FEATURE_INDEP_PG_MAP | 17 | 20000 | |||||
CEPH_FEATURE_CRUSH_TUNABLES | 18 | 40000 | S | S | S | S | S |
CEPH_FEATURE_CHUNKY_SCRUB | 19 | 80000 | |||||
CEPH_FEATURE_MON_NULLROUTE | 20 | 100000 | |||||
CEPH_FEATURE_MON_GV | 21 | 200000 | |||||
CEPH_FEATURE_BACKFILL_RESERVATION | 22 | 400000 | |||||
CEPH_FEATURE_MSG_AUTH | 23 | 800000 | |||||
CEPH_FEATURE_RECOVERY_RESERVATION | 24 | 1000000 | |||||
CEPH_FEATURE_CRUSH_TUNABLES2 | 25 | 2000000 | S | S | S | S | |
CEPH_FEATURE_CREATEPOOLID | 26 | 4000000 | |||||
CEPH_FEATURE_REPLY_CREATE_INODE | 27 | 8000000 | S | S | S | S | |
CEPH_FEATURE_OSD_HBMSGS | 28 | 10000000 | |||||
CEPH_FEATURE_MDSENC | 29 | 20000000 | |||||
CEPH_FEATURE_OSDHASHPSPOOL | 30 | 40000000 | S | S | S | S | |
CEPH_FEATURE_MON_SINGLE_PAXOS | 31 | 80000000 | |||||
CEPH_FEATURE_OSD_SNAPMAPPER | 32 | 100000000 | |||||
CEPH_FEATURE_MON_SCRUB | 33 | 200000000 | |||||
CEPH_FEATURE_OSD_PACKED_RECOVERY | 34 | 400000000 | |||||
CEPH_FEATURE_OSD_CACHEPOOL | 35 | 800000000 | |||||
CEPH_FEATURE_CRUSH_V2 | 36 | 1000000000 | |||||
CEPH_FEATURE_EXPORT_PEER | 37 | 2000000000 | |||||
CEPH_FEATURE_OSD_ERASURE_CODES | 38 | 4000000000 | |||||
CEPH_FEATURE_OSD_TMAP2OMAP | 38 | 8000000000 | |||||
CEPH_FEATURE_OSDMAP_ENC | 39 | 10000000000 |