Feature Set Mismatch Error on Ceph Kernel Client

出现这种错误，根据Ceph Feature信息使用匹配的kernel,进行kernel升级。 ceph0.80.1 可以升级到kernel 3.14.12

Depending on the kernel version you may be missing some features required by the cluster (or vice versa, required by client but not available on the cluster). Hence the errors “feature set mismatch”.

Some examples of errors that can be encountered :

mon0 192.168.0.1:6789 feature set mismatch, my 4a042a42 < server's 84a042a42, missing 2040000

—> Upgrade kernel client up to 3.9 or set tunables to legacy : ceph osd crush tunables legacy

mon0 192.168.0.1:6789 feature set mismatch, my 4a042a42 < server's 84a042a42, missing 40000000

—> Upgrade kernel client up to 3.9 or unset hashpspool : ceph osd pool set rbd hashpspool false

mon0 192.168.0.1:6789 feature set mismatch, my 4a042a42 < server's 84a042a42, missing 800000000

—> Remove cache pool and reload monitors

CEPH_FEATURE Table and Kernel Version

You can find the feature missing in that table (HEX)

For exemple, missing 2040000 means that CEPH_FEATURE_CRUSH_TUNABLES (40000) and CEPH_FEATURE_CRUSH_TUNABLES2 (2000000) is missing on kernel client.

‘R’:required, ’S’:support

Feature	BIT	HEX	3.8	3.9	3.10	3.11	3.12
CEPH_FEATURE_UID	0	1
CEPH_FEATURE_NOSRCADDR	1	2	R	R	R	R	R
CEPH_FEATURE_MONCLOCKCHECK	2	4
CEPH_FEATURE_FLOCK	3	8
CEPH_FEATURE_SUBSCRIBE2	4	10
CEPH_FEATURE_MONNAMES	5	20
CEPH_FEATURE_RECONNECT_SEQ	6	40	R	R	R
CEPH_FEATURE_DIRLAYOUTHASH	7	80
CEPH_FEATURE_OBJECTLOCATOR	8	100
CEPH_FEATURE_PGID64	9	200	R	R	R	R
CEPH_FEATURE_INCSUBOSDMAP	10	400
CEPH_FEATURE_PGPOOL3	11	800	R	R	R	R
CEPH_FEATURE_OSDREPLYMUX	12	1000
CEPH_FEATURE_OSDENC	13	2000	R	R	R	R
CEPH_FEATURE_OMAP	14	4000
CEPH_FEATURE_MONENC	15	8000
CEPH_FEATURE_QUERY_T	16	10000
CEPH_FEATURE_INDEP_PG_MAP	17	20000
CEPH_FEATURE_CRUSH_TUNABLES	18	40000	S	S	S	S	S
CEPH_FEATURE_CHUNKY_SCRUB	19	80000
CEPH_FEATURE_MON_NULLROUTE	20	100000
CEPH_FEATURE_MON_GV	21	200000
CEPH_FEATURE_BACKFILL_RESERVATION	22	400000
CEPH_FEATURE_MSG_AUTH	23	800000
CEPH_FEATURE_RECOVERY_RESERVATION	24	1000000
CEPH_FEATURE_CRUSH_TUNABLES2	25	2000000	S	S	S	S
CEPH_FEATURE_CREATEPOOLID	26	4000000
CEPH_FEATURE_REPLY_CREATE_INODE	27	8000000	S	S	S	S
CEPH_FEATURE_OSD_HBMSGS	28	10000000
CEPH_FEATURE_MDSENC	29	20000000
CEPH_FEATURE_OSDHASHPSPOOL	30	40000000	S	S	S	S
CEPH_FEATURE_MON_SINGLE_PAXOS	31	80000000
CEPH_FEATURE_OSD_SNAPMAPPER	32	100000000
CEPH_FEATURE_MON_SCRUB	33	200000000
CEPH_FEATURE_OSD_PACKED_RECOVERY	34	400000000
CEPH_FEATURE_OSD_CACHEPOOL	35	800000000
CEPH_FEATURE_CRUSH_V2	36	1000000000
CEPH_FEATURE_EXPORT_PEER	37	2000000000
CEPH_FEATURE_OSD_ERASURE_CODES	38	4000000000
CEPH_FEATURE_OSD_TMAP2OMAP	38	8000000000
CEPH_FEATURE_OSDMAP_ENC	39	10000000000