2021-10-15

   **ExadataX3 -2  更换硬盘出现rejected due to wrong slot** 

服务器环境 Exadata X3-2 1/8配
第一章 故障描述 3
1.1 报错信息 3
1.2 操作步骤 4
第二章 处理过程 5
第三章 建议 6

第一章 故障描述
1.1 报错信息
报错信息如下：[root@dm02cel01 ~]# cellcli -e list physicaldisk
20:0 E10WGQ warning - predictive failure
20:1 K8YH1N normal
20:2 K9HKLN normal
20:3 K76BUN normal
20:4 K9HG1N normal
20:5 K5A8BN normal
20:6 K6KBHN normal
20:7 KP8GXM normal
20:8 KEN41L normal
20:9 KE693L normal
20:10 E0Z7E9 normal
20:11 KZMPWL normal
FLASH_1_0 5L0049JL normal
FLASH_1_1 5L0049JK normal
FLASH_1_2 5L0049JJ normal
FLASH_1_3 5L0043JG normal
FLASH_2_0 FL003N2R normal
FLASH_2_1 FL003MHF normal
FLASH_2_2 FL003ND7 normal
FLASH_2_3 FL003KZ7 normal
FLASH_4_0 FL003L2E normal
FLASH_4_1 FL003N8F normal
FLASH_4_2 FL003LNV normal
FLASH_4_3 FL003N0P normal
FLASH_5_0 5L000QHY normal
FLASH_5_1 5L000QM0 normal
经检查确认dm02cel01 20:0 硬盘故障需要更换
1.2 操作步骤
更换硬盘操作如下：
a.首先检查是否有数据同步，没有可进行下一步操作
[root@dm02db01 ~]# su - grid
[grid@dm02db01 ~]$ sqlplus / as sysdba
SQL*Plus: Release 12.1.0.2.0 Production on Sat Oct 9 14:43:43 2021
Copyright © 1982, 2014, Oracle. All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
SQL> select * from gv$asm_operation;
no rows selected
b.更换故障硬盘
[root@dm02cel01 ~]# cellcli -e alter cell led on
Cell dm02cel01 Locator LED switched on
[root@dm02cel01 ~]# cellcli -e alter physicaldisk 20:0
Physicaldisk 20:0 successfully altered.
[root@dm02cel01 ~]# cellcli -e alter physicaldisk 20:0 drop for replacement
Physical disk 20:0 was dropped for replacement.
[root@dm02cel01 ~]# cellcli -e list physicaldisk
20:0 E10WGQ warning - predictive failure - dropped for replacement
20:1 K8YH1N normal
20:2 K9HKLN normal
20:3 K76BUN normal
20:4 K9HG1N normal
20:5 K5A8BN normal
20:6 K6KBHN normal
20:7 KP8GXM normal
20:8 KEN41L normal
20:9 KE693L normal
20:10 E0Z7E9 normal
20:11 KZMPWL normal
FLASH_1_0 5L0049JL normal
FLASH_1_1 5L0049JK normal
FLASH_1_2 5L0049JJ normal
FLASH_1_3 5L0043JG normal
FLASH_2_0 FL003N2R normal
FLASH_2_1 FL003MHF normal
FLASH_2_2 FL003ND7 normal
FLASH_2_3 FL003KZ7 normal
FLASH_4_0 FL003L2E normal
FLASH_4_1 FL003N8F normal
FLASH_4_2 FL003LNV normal
FLASH_4_3 FL003N0P normal
FLASH_5_0 5L000QHY normal
FLASH_5_1 5L000QM0 normal
FLASH_5_2 5L0010CF normal
FLASH_5_3 5L0010NR normal
检查硬盘状态为replacement可更换物理硬盘，拔出坏盘后等待3min，插入新盘后等1~3min再进行操作。
更换完成后检查硬盘状态
[root@dm02cel01 ~]# cellcli -e list physicaldisk
20:0 EA0B5N normal - rejected due to wrong slot
20:1 K8YH1N normal
20:2 K9HKLN normal
20:3 K76BUN normal
20:4 K9HG1N normal
20:5 K5A8BN normal
20:6 K6KBHN normal
20:7 KP8GXM normal
20:8 KEN41L normal
20:9 KE693L normal
20:10 E0Z7E9 normal
20:11 KZMPWL normal
FLASH_1_0 5L0049JL normal
FLASH_1_1 5L0049JK normal
FLASH_1_2 5L0049JJ normal
FLASH_1_3 5L0043JG normal
FLASH_2_0 FL003N2R normal
FLASH_2_1 FL003MHF normal
FLASH_2_2 FL003ND7 normal
FLASH_2_3 FL003KZ7 normal
FLASH_4_0 FL003L2E normal
FLASH_4_1 FL003N8F normal
FLASH_4_2 FL003LNV normal
FLASH_4_3 FL003N0P normal
FLASH_5_0 5L000QHY normal
FLASH_5_1 5L000QM0 normal
FLASH_5_2 5L0010CF normal
FLASH_5_3 5L0010NR normal
更换硬盘后，检查硬盘状态为normal - rejected due to wrong slot通过官方文档检查更换硬盘后触发系统bug，导致硬盘状态出现问题。

第二章 处理过程
1.执行以下命令清除新更换的硬盘的Raid信息
[root@dm02cel01 ~]#MegaCli64 -CfgForeign -Clear -a0
[root@dm02cel01 ~]#MegaCli -CfgForeign -Clear -aALL
[root@dm02cel01~]#MegaCli64 -CfgLdAdd -R0 [20:0] WB NORA Direct NoCachedBadBBU -strpsz1024 -a0
2.执行以下命令清除硬盘的normal -rejected due to wrong slot的状态
[root@dm02cel01~]# /opt/MegaRAID/MegaCli/MegaCli64 -GetPreservedCacheList -a0
[root@dm02cel01~]# /opt/MegaRAID/MegaCli/MegaCli64 -DiscardPreservedCache -LAll -a0
3.执行以下命令添加硬盘
[root@dm02cel01~]# MegaCli64 -cfgldadd -r0[20:0] -a0
[root@dm02cel01~]# cellcli -e alter physicaldisk 20:0 reenable force
4.检查硬盘状态及是否有数据同步
[root@dm02cel01~]#cellcli -e list physicaldisk
20:0 EA0B5N normal

5.硬盘数据同步完成，更换完成