ORA-03137: TTC protocol internal error: [12333]分析及处理

DB: Oracle 11.2.0.1 

OS: Redhat Linux 5.3 64bit

異常：

阳春三月的周末，正准备出门踏青，突然接到用户的电话说一个程序使用中报错ORA-03113，但其它功能程式可正常使用。

检查DB日志 alert.log:

Sat Apr 14 10:43:04 2018

Errors in file /u01/product/diag/rdbms/orcl/orcl/trace/orcl_ora_2189.trc  (incident=386284):

ORA-03137: TTC 协议内部错误: [12333] [12] [48] [48] [] [] [] []

Sat Apr 14 10:43:05 2018

Sweep [inc][386284]: completed

Sat Apr 14 10:43:09 2018

Errors in file /u01/product/diag/rdbms/orcl/orcl/trace/orcl_ora_2244.trc  (incident=386371):

ORA-03137: TTC 协议内部错误: [12333] [12] [48] [48] [] [] [] []

Sat Apr 14 10:44:05 2018

Sweep [inc][386371]: completed

使用oerr查看报错说明，哇，错误解决要联系Oracle Support Services。。。

$oerr ora 3137

03137, 00000, "TTC protocol internal error : [%s] [%s] [%s] [%s] [%s] [%s] [%s] [%s]"

// *Cause:  TTC protocol internal error.

// *Action: Contact Oracle Support Services.

还是先自己看看吧，进一步查看报错生产的trc文件：

Trace file /u01/product/diag/rdbms/orcl/orcl/trace/orcl_ora_2189.trc

Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production

With the Partitioning, Oracle Label Security, OLAP, Data Mining,

Oracle Database Vault and Real Application Testing options

ORACLE_HOME = /u01/product/oracle

System name:  Linux

Node name:     SFCDB

Release:  2.6.18-128.el5

Version:   #1 SMP Wed Dec 17 11:41:38 EST 2008

Machine: x86_64

Instance name: orcl

Redo thread mounted by this instance: 1

Oracle process number: 194

Unix process pid: 2189, image: oracle@SFCDB

*** 2018-04-14 10:43:04.436

*** SESSION ID:(197.17986) 2018-04-14 10:43:04.436

*** CLIENT ID:() 2018-04-14 10:43:04.436

*** SERVICE NAME:(orcl) 2018-04-14 10:43:04.436

*** MODULE NAME:(DFMS.exe) 2018-04-14 10:43:04.436

*** ACTION NAME:() 2018-04-14 10:43:04.436

--- PROTOCOL VIOLATION DETECTED ---

----- Dump Cursor sql_id=9pmx42bttx2st xsc=0x2b48f67503b8 cur=0x2b48f6381c50 -----

LibraryHandle:  Address=2bd38090 Hash=f39e8b19 LockMode=N PinMode=0 LoadLockMode=0 Status=VALD

  ObjectName:  Name= Select serial_number from R_SN_LASER_CARVING_PRINT_T  WHERE MO_NUMBER=:MO AND STATE_FLAG='0' ORDER BY SERIAL_NUMBER ASC

    FullHashValue=12484201093a22129acfa412f39e8b19 Namespace=SQL AREA(00) Type=CURSOR(00) Identifier=4087253785 OwnerIdn=91

  Statistics:  InvalidationCount=17 ExecutionCount=42034 LoadCount=57 ActiveLocks=1 TotalLockCount=831 TotalPinCount=1

  Counters:  BrokenCount=1 RevocablePointer=1 KeepDependency=4 KeepHandle=4 BucketInUse=824 HandleInUse=824

  Concurrency:  DependencyMutex=2bd38140(0, 0, 0, 0) Mutex=2bd381b8(197, 6821, 0, 6)

  Flags=RON/PIN/TIM/PN0/DBN/[10012841]

  WaitersLists: 

    Lock=2bd38120[2bd38120,2bd38120]

    Pin=2bd38130[2bd38100,2bd38100]

  Timestamp:  Current=03-30-2018 15:42:57

  LibraryObject:  Address=282e40b0 HeapMask=0000-0001-0001 Flags=EXS[0000] Flags2=[0000] PublicFlags=[0000]

    ChildTable:  size='16'

      Child:  id='0' Table=282e4f60 Reference=282e4a00 Handle=2bd37e90

      Child:  id='1' Table=282e4f60 Reference=282e4d28 Handle=8755c338

      Child:  id='2' Table=282e4f60 Reference=28f1ef18 Handle=628e66f0

      Child:  id='3' Table=282e4f60 Reference=382cf368 Handle=87e39fa0

    Children: 

      Child:  childNum='0'

        LibraryHandle:  Address=2bd37e90 Hash=0 LockMode=0 PinMode=0 LoadLockMode=0 Status=VALD

          Name:  Namespace=SQL AREA(00) Type=CURSOR(00)

          Statistics:  InvalidationCount=0 ExecutionCount=100 LoadCount=19 ActiveLocks=0 TotalLockCount=388 TotalPinCount=15647

          Counters:  BrokenCount=1 RevocablePointer=1 KeepDependency=0 KeepHandle=0 BucketInUse=0 HandleInUse=0

          Concurrency:  DependencyMutex=2bd37f40(0, 0, 0, 0) Mutex=2bd381b8(197, 6821, 0, 6)

          Flags=RON/PIN/PN0/EXP/[10012111]

          WaitersLists: 

            Lock=2bd37f20[2bd37f20,2bd37f20]

            Pin=2bd37f30[2bd37f00,2bd37f00]

          LibraryObject:  Address=386860b0 HeapMask=0000-0001-0001 Flags=EXS[0000] Flags2=[0000] PublicFlags=[0000]

          NamespaceDump: 

            Child Cursor:  Heap0=0x138686198 Heap6=0x12bd37e90 Heap0 Load Time=04-14-2018 08:57:09 Heap6 Load Time=04-14-2018 08:57:09

      Child:  childNum='1'

        LibraryHandle:  Address=8755c338 Hash=0 LockMode=0 PinMode=0 LoadLockMode=0 Status=VALD

          Name:  Namespace=SQL AREA(00) Type=CURSOR(00)

          Statistics:  InvalidationCount=0 ExecutionCount=72 LoadCount=15 ActiveLocks=0 TotalLockCount=495 TotalPinCount=22196

          Counters:  BrokenCount=1 RevocablePointer=1 KeepDependency=0 KeepHandle=0 BucketInUse=0 HandleInUse=0

          Concurrency:  DependencyMutex=8755c3e8(0, 0, 0, 0) Mutex=2bd381b8(197, 6821, 0, 6)

          Flags=RON/PIN/PN0/EXP/[10012111]

          WaitersLists: 

            Lock=8755c3c8[8755c3c8,8755c3c8]

            Pin=8755c3d8[8755c3a8,8755c3a8]

          LibraryObject:  Address=564f97c0 HeapMask=0000-0001-0001 Flags=EXS[0000] Flags2=[0000] PublicFlags=[0000]

          NamespaceDump: 

            Child Cursor:  Heap0=0x1564f98a8 Heap6=0x1227353c0 Heap0 Load Time=04-14-2018 09:46:29 Heap6 Load Time=04-14-2018 10:02:56

      Child:  childNum='2'

        LibraryHandle:  Address=628e66f0 Hash=0 LockMode=0 PinMode=0 LoadLockMode=0 Status=VALD

          Name:  Namespace=SQL AREA(00) Type=CURSOR(00)

          Statistics:  InvalidationCount=0 ExecutionCount=1810 LoadCount=3 ActiveLocks=0 TotalLockCount=123 TotalPinCount=3063

          Counters:  BrokenCount=1 RevocablePointer=1 KeepDependency=0 KeepHandle=0 BucketInUse=0 HandleInUse=0

          Concurrency:  DependencyMutex=628e67a0(0, 0, 0, 0) Mutex=2bd381b8(197, 6821, 0, 6)

          Flags=RON/PIN/PN0/EXP/[10012111]

          WaitersLists: 

            Lock=628e6780[628e6780,628e6780]

            Pin=628e6790[628e6760,628e6760]

          LibraryObject:  Address=56bc87c0 HeapMask=0000-0001-0001 Flags=EXS/RIV[0200] Flags2=[0000] PublicFlags=[0000]

          NamespaceDump: 

            Child Cursor:  Heap0=0x156bc88a8 Heap6=0x1273bb830 Heap0 Load Time=04-13-2018 16:50:25 Heap6 Load Time=04-13-2018 16:50:25

      Child:  childNum='3'

        LibraryHandle:  Address=87e39fa0 Hash=0 LockMode=N PinMode=S LoadLockMode=0 Status=VAL