oracle启动后磁盘占有100,ogg目标端磁盘空间使用率100%，导致ogg 进程 abended

2016-07-25 13:54:57  ERROR   OGG-01031  Oracle GoldenGate Capture for Oracle, pump02.prm:  There is a problem in network communication, a remote file problem, encryption keys for target and source do not match (if using ENCRYPT) or an unknown error. (Reply received is error 28 positioning queue file ./dirdat/VB000060 to rba 31817623 (No space left on device)).

2016-07-25 13:54:57  ERROR   OGG-01668  Oracle GoldenGate Capture for Oracle, pump02.prm:  PROCESS ABENDING.

刚刚观察测试库gg运行状况发现，pump进程异常abend，err log报错日志。

该错误官方说明如下：

OGG-01031: There is a problem in network communication, a remote file problem,

encryption keys for target and source do not match (if using ENCRYPT) or an

unknown error. (Reply received is {0})

Cause: Extract was not able to send data to the target.

Action: Examine the network for an outage between the source and target system.

Make certain that MGRPORT in RMTHOST matches the one in the parameter file

of the remote Manager. Check for errors on the target system that indicate the

Manager or Collector process is not running, or that Collector does not have

privileges to write to the remote trail. Check for encryption errors if the ENCRYPT

option is specified with the RMTHOST or RMTHOSTOPTIONS parameter: This

might indicate that the encryption key that was sent from the source does not

match the one in the ENCKEYS file on the target, or that the key or ENCKEYS file

on the target is missing.

登录目标端查看：

所有ogg进程不可用，重启依然不可用。从ggserr.log查看日志信息，发现oracle数据库由于磁盘空间使用率达到100%，导致实例异常终止。

数据库日志

--

Current log# 2 seq# 38 mem# 0: /home/db/oracle/oradata/PMOINQdb1/redo02.log

Thread 1 advanced to log sequence 39 (LGWR switch)

Current log# 3 seq# 39 mem# 0: /home/db/oracle/oradata/PMOINQdb1/redo03.log

Mon Jul 25 13:53:45 2016

Non critical error ORA-48181 caught while writing to trace file "/home/db/oracle/diag/rdbms/pmoinqdb1/PMOINQdb1/trace/PMOINQdb1_dbw0_2513.trc"

Error message: Linux-x86_64 Error: 28: No space left on device

Additional information: 1

Writing to the above trace file is disabled for now on...

KCF: read, write or open error, block=0x3981 online=1

file=1 '/home/db/oracle/oradata/PMOINQdb1/temp01.dbf'

error=27072 txt: 'Additional information: 4

Additional information: 14721

Additional information: 40960'

Errors in file /home/db/oracle/diag/rdbms/pmoinqdb1/PMOINQdb1/trace/PMOINQdb1_dbw0_2513.trc:

Errors in file /home/db/oracle/diag/rdbms/pmoinqdb1/PMOINQdb1/trace/PMOINQdb1_dbw0_2513.trc:

ORA-63999: data file suffered media failure

ORA-01114: IO error writing block to file 201 (block # 14721)

ORA-01110: data file 201: '/home/db/oracle/oradata/PMOINQdb1/temp01.dbf'

ORA-27072: File I/O error

Additional information: 4

Additional information: 14721

Additional information: 40960

Mon Jul 25 13:53:45 2016

Non critical error ORA-48181 caught while writing to trace file "/home/db/oracle/diag/rdbms/pmoinqdb1/PMOINQdb1/trace/PMOINQdb1_diag_2505.trc"

Error message: Linux-x86_64 Error: 28: No space left on device

Additional information: 1

Writing to the above trace file is disabled for now on...

System state dump requested by (instance=1, osid=2513 (DBW0)), summary=[abnormal instance termination].

System State dumped to trace file /home/db/oracle/diag/rdbms/pmoinqdb1/PMOINQdb1/trace/PMOINQdb1_diag_2505.trc

DBW0 (ospid: 2513): terminating the instance due to error 63999

Dumping diagnostic data in directory=[cdmp_20160725135345], requested by (instance=1, osid=2513 (DBW0)), summary=[abnormal instance termination].

--

然后重新启动数据库，重新启动发生abended的ogg进程即可。

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/30393815/viewspace-2122707/，如需转载，请注明出处，否则将追究法律责任。