GoldenGate initial load 直接传输初始化
OGG单向复制配置请查看 http://blog.itpub.net/21582653/viewspace-1843356/
在源端和目标端启动mgr
GGSCI (oradb) 2> start mgr
Manager started.
在源端配置 initial load extract 进程组
SQL>
alter table lixia.t10 add primary key(OBJECT_ID);
或者
alter table lixia.t10 add constraint PK_T10 primary key (OBJECT_ID);
GGSCI (oradb) 7> edit params extinit
extract extinit
userid ggs,password ggs
rmthost 192.168.222.154,mgrport 7809
rmttask replicat,group repinit
table lixia.t10;
table lixia.demo;
GGSCI (oradb) 12> add extract extinit,sourceistable
EXTRACT added.
GGSCI (oradb) 8> info extract *,tasks
EXTRACT EXTINIT Initialized 2015-11-17 21:01 Status STOPPED
Checkpoint Lag Not Available
Log Read Checkpoint Not Available
First Record Record 0
Task SOURCEISTABLE
GGSCI (oradb) 24> dblogin userid ggs,password ggs
Successfully logged into database.
GGSCI (oradb as ggs@dilas1) 25> add trandata lixia.t10;
ERROR: No viable tables matched specification.
在目标端配置初始化replicat进程
GGSCI (fmsserver) 7> edit params repinit
replicat repinit
assumetargetdefs
userid ggs,password ggs
discardfile ./dirrpt/repinit.dsc,purge
map lixia.t10,target lixia.t10;
GGSCI (fmsserver) 5> add replicat repinit,specialrun
REPLICAT added.
GGSCI (fmsserver) 6> info replicat *,tasks
REPLICAT REPINIT Initialized 2015-11-17 21:11 Status STOPPED
Checkpoint Lag 00:00:00 (updated 00:00:26 ago)
Log Read Checkpoint Not Available
Task SPECIALRUN
2.完成数据初始化加载
(1) 启动源端的抽取进程
GGSCI (oradb) 7> start EXTRACT EIEX01
Sending START request to MANAGER ...
EXTRACT EIEX01 starting
(2) 在源端插入数据
declare
j number :=0;
begin
for i in 1000001 ..1000200 loop
j:=j+1;
--dbms_output.put_line('one j'||j);
insert into lixia.t10 (object_id,object_name)
values (i,'test'||i);
if (j=10) then
DBMS_LOCK.SLEEP(1);
j:=0;
commit;
end if;
--dbms_output.put_line('two j'||j);
end loop;
end;
/
(3) 插入数据的同时源端启动批量抽取进程
GGSCI (oradb as ggs@dilas1) 81> start extinit
Sending START request to MANAGER ...
EXTRACT EXTINIT starting
在目标端查看已经初始化了3000条记录,这个时候把目标端的网卡禁用
SQL> select count(1) from lixia.t10;
COUNT(1)
----------
3000
查看源端OGG的状态
GGSCI (oradb) 14> info extract *,tasks
EXTRACT EXTINIT Last Started 2015-11-18 22:26 Status RUNNING
Checkpoint Lag Not Available
Process ID 28870
Log Read Checkpoint Table LIXIA.T10
2015-11-18 22:26:43 Record 30862
Task SOURCEISTABLE
大概过了15分钟启用目标端的网卡,数据初始化继续(不会出现错误)
查询目标端数据
SQL> select count(1) from lixia.t10;
COUNT(1)
----------
87514
同步完成
GGSCI (oradb) 53> view report EXTINIT
2015-11-18 23:12:25 INFO OGG-01017 Wildcard resolution set to IMMEDIATE because SOURCEISTABLE is used.
***********************************************************************
Oracle GoldenGate Capture for Oracle
Version 12.1.2.1.0 OGGCORE_12.1.2.1.0_PLATFORMS_140727.2135.1_FBO
Linux, x64, 64bit (optimized), Oracle 11g on Aug 7 2014 09:31:26
Copyright (C) 1995, 2014, Oracle and/or its affiliates. All rights reserved.
Starting at 2015-11-18 23:12:25
***********************************************************************
Operating System Version:
Linux
Version #1 SMP Tue Jan 29 11:47:41 EST 2013, Release 2.6.32-358.el6.x86_64
Node: oradb
Machine: x86_64
soft limit hard limit
Address Space Size : unlimited unlimited
Heap Size : unlimited unlimited
File Size : unlimited unlimited
CPU Time : unlimited unlimited
Process id: 42709
Description:
***********************************************************************
** Running with the following parameters **
***********************************************************************
2015-11-18 23:12:25 INFO OGG-03059 Operating system character set identified as UTF-8.
2015-11-18 23:12:25 INFO OGG-02695 ANSI SQL parameter syntax is used for parameter parsing.
extract extinit
userid ggs,password ***
2015-11-18 23:12:25 INFO OGG-03522 Setting session time zone to source database time zone 'GMT'.
rmthost 192.168.222.154,mgrport 7809
rmttask replicat,group REPINIT
table lixia.t10;
2015-11-18 23:12:25 INFO OGG-06509 Using the following key columns for source table LIXIA.T10: OBJECT_ID.
2015-11-18 23:12:25 INFO OGG-01851 filecaching started: thread ID: 140425613342464.
2015-11-18 23:12:25 INFO OGG-01815 Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON) anon free: munmap
file alloc: mmap(MAP_SHARED) file free: munmap
target directories:
/app/gg2/dirtmp.
CACHEMGR virtual memory values (may have been adjusted)
CACHESIZE: 64G
CACHEPAGEOUTSIZE (default): 8M
PROCESS VM AVAIL FROM OS (min): 128G
CACHESIZEMAX (strict force to disk): 96G
Database Version:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
PL/SQL Release 11.2.0.4.0 - Production
CORE 11.2.0.4.0 Production
TNS for Linux: Version 11.2.0.4.0 - Production
NLSRTL Version 11.2.0.4.0 - Production
Database Language and Character Set:
NLS_LANGUAGE = "AMERICAN"
NLS_TERRITORY = "AMERICA"
NLS_CHARACTERSET = "ZHS16GBK"
Processing table LIXIA.T10
***********************************************************************
* ** Run Time Statistics ** *
***********************************************************************
Report at 2015-11-18 23:12:44 (activity since 2015-11-18 23:12:25)
Output to REPINIT:
From Table LIXIA.T10:
# inserts: 108654
# updates: 0
# deletes: 0
# discards: 0
REDO Log Statistics
Bytes parsed 0
Bytes output 29620233
GGSCI (oradb) 54> info extract *,tasks
EXTRACT EXTINIT Last Started 2015-11-18 23:12 Status STOPPED
Checkpoint Lag Not Available
Log Read Checkpoint Table LIXIA.T10
2015-11-18 23:12:44 Record 108654
Task SOURCEISTABLE
源端OGG日志
2015-11-18 23:12:25 INFO OGG-00993 Oracle GoldenGate Capture for Oracle, extinit.prm: EXTRACT EXTINIT started.
2015-11-18 23:12:44 INFO OGG-00991 Oracle GoldenGate Capture for Oracle, extinit.prm: EXTRACT EXTINIT stopped normally.
在源端启动投递进程
GGSCI (oradb) 56> view params DPMP01
extract dpmp01
passthru
rmthost 192.168.222.154,mgrport 7809
rmttrail ./dirdat/td
--exttrail ./dirdat/tt
table lixia.*;
GGSCI (oradb) 24> start EXTRACT DPMP01
Sending START request to MANAGER ...
EXTRACT DPMP01 starting
在目标端启动复制进程
GGSCI (fmsserver) 2> edit params REPL
replicat repl
userid ggs,password ggs
HANDLECOLLISIONS
ASSUMETARGETDEFS
discardfile ./dirrpt/repl.dec,purge
map lixia.demo,target lixia.demo;
map lixia.t10,target lixia.t10;
GGSCI (fmsserver) 4> start REPL
REPLICAT REPL is already running.
查看目标端复制进程状态,直到大大于 load结束的时间
GGSCI (fmsserver) 8> info REPL
REPLICAT REPL Last Started 2015-11-18 22:53 Status RUNNING
Checkpoint Lag 00:00:00 (updated 00:00:07 ago)
Process ID 71838
Log Read Checkpoint File ./dirdat/td000008
2015-11-18 23:14:02.909934 RBA 54073 --查看这个时间
查看源端T10表的记录数和目标端的T10表记录数一致。
关闭目标端复制进程的数据冲突检查
GGSCI (fmsserver) 10> send replicat repl,NOHANDLECOLLISIONS
Sending NOHANDLECOLLISIONS request to REPLICAT REPL ...
REPL No tables found matching * to set NOHANDLECOLLISIONS.
去掉目标端复制进程参数文件中的数据冲突检查
GGSCI (fmsserver) 11> edit params repl
replicat repl
userid ggs,password ggs
--HANDLECOLLISIONS
ASSUMETARGETDEFS
discardfile ./dirrpt/repl.dec,purge
map lixia.demo,target lixia.demo;
map lixia.t10,target lixia.t10;
OGG单向复制配置请查看 http://blog.itpub.net/21582653/viewspace-1843356/
在源端和目标端启动mgr
GGSCI (oradb) 2> start mgr
Manager started.
在源端配置 initial load extract 进程组
SQL>
alter table lixia.t10 add primary key(OBJECT_ID);
或者
alter table lixia.t10 add constraint PK_T10 primary key (OBJECT_ID);
GGSCI (oradb) 7> edit params extinit
extract extinit
userid ggs,password ggs
rmthost 192.168.222.154,mgrport 7809
rmttask replicat,group repinit
table lixia.t10;
table lixia.demo;
GGSCI (oradb) 12> add extract extinit,sourceistable
EXTRACT added.
GGSCI (oradb) 8> info extract *,tasks
EXTRACT EXTINIT Initialized 2015-11-17 21:01 Status STOPPED
Checkpoint Lag Not Available
Log Read Checkpoint Not Available
First Record Record 0
Task SOURCEISTABLE
GGSCI (oradb) 24> dblogin userid ggs,password ggs
Successfully logged into database.
GGSCI (oradb as ggs@dilas1) 25> add trandata lixia.t10;
ERROR: No viable tables matched specification.
在目标端配置初始化replicat进程
GGSCI (fmsserver) 7> edit params repinit
replicat repinit
assumetargetdefs
userid ggs,password ggs
discardfile ./dirrpt/repinit.dsc,purge
map lixia.t10,target lixia.t10;
GGSCI (fmsserver) 5> add replicat repinit,specialrun
REPLICAT added.
GGSCI (fmsserver) 6> info replicat *,tasks
REPLICAT REPINIT Initialized 2015-11-17 21:11 Status STOPPED
Checkpoint Lag 00:00:00 (updated 00:00:26 ago)
Log Read Checkpoint Not Available
Task SPECIALRUN
2.完成数据初始化加载
(1) 启动源端的抽取进程
GGSCI (oradb) 7> start EXTRACT EIEX01
Sending START request to MANAGER ...
EXTRACT EIEX01 starting
(2) 在源端插入数据
declare
j number :=0;
begin
for i in 1000001 ..1000200 loop
j:=j+1;
--dbms_output.put_line('one j'||j);
insert into lixia.t10 (object_id,object_name)
values (i,'test'||i);
if (j=10) then
DBMS_LOCK.SLEEP(1);
j:=0;
commit;
end if;
--dbms_output.put_line('two j'||j);
end loop;
end;
/
(3) 插入数据的同时源端启动批量抽取进程
GGSCI (oradb as ggs@dilas1) 81> start extinit
Sending START request to MANAGER ...
EXTRACT EXTINIT starting
在目标端查看已经初始化了3000条记录,这个时候把目标端的网卡禁用
SQL> select count(1) from lixia.t10;
COUNT(1)
----------
3000
查看源端OGG的状态
GGSCI (oradb) 14> info extract *,tasks
EXTRACT EXTINIT Last Started 2015-11-18 22:26 Status RUNNING
Checkpoint Lag Not Available
Process ID 28870
Log Read Checkpoint Table LIXIA.T10
2015-11-18 22:26:43 Record 30862
Task SOURCEISTABLE
大概过了15分钟启用目标端的网卡,数据初始化继续(不会出现错误)
查询目标端数据
SQL> select count(1) from lixia.t10;
COUNT(1)
----------
87514
同步完成
GGSCI (oradb) 53> view report EXTINIT
2015-11-18 23:12:25 INFO OGG-01017 Wildcard resolution set to IMMEDIATE because SOURCEISTABLE is used.
***********************************************************************
Oracle GoldenGate Capture for Oracle
Version 12.1.2.1.0 OGGCORE_12.1.2.1.0_PLATFORMS_140727.2135.1_FBO
Linux, x64, 64bit (optimized), Oracle 11g on Aug 7 2014 09:31:26
Copyright (C) 1995, 2014, Oracle and/or its affiliates. All rights reserved.
Starting at 2015-11-18 23:12:25
***********************************************************************
Operating System Version:
Linux
Version #1 SMP Tue Jan 29 11:47:41 EST 2013, Release 2.6.32-358.el6.x86_64
Node: oradb
Machine: x86_64
soft limit hard limit
Address Space Size : unlimited unlimited
Heap Size : unlimited unlimited
File Size : unlimited unlimited
CPU Time : unlimited unlimited
Process id: 42709
Description:
***********************************************************************
** Running with the following parameters **
***********************************************************************
2015-11-18 23:12:25 INFO OGG-03059 Operating system character set identified as UTF-8.
2015-11-18 23:12:25 INFO OGG-02695 ANSI SQL parameter syntax is used for parameter parsing.
extract extinit
userid ggs,password ***
2015-11-18 23:12:25 INFO OGG-03522 Setting session time zone to source database time zone 'GMT'.
rmthost 192.168.222.154,mgrport 7809
rmttask replicat,group REPINIT
table lixia.t10;
2015-11-18 23:12:25 INFO OGG-06509 Using the following key columns for source table LIXIA.T10: OBJECT_ID.
2015-11-18 23:12:25 INFO OGG-01851 filecaching started: thread ID: 140425613342464.
2015-11-18 23:12:25 INFO OGG-01815 Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON) anon free: munmap
file alloc: mmap(MAP_SHARED) file free: munmap
target directories:
/app/gg2/dirtmp.
CACHEMGR virtual memory values (may have been adjusted)
CACHESIZE: 64G
CACHEPAGEOUTSIZE (default): 8M
PROCESS VM AVAIL FROM OS (min): 128G
CACHESIZEMAX (strict force to disk): 96G
Database Version:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
PL/SQL Release 11.2.0.4.0 - Production
CORE 11.2.0.4.0 Production
TNS for Linux: Version 11.2.0.4.0 - Production
NLSRTL Version 11.2.0.4.0 - Production
Database Language and Character Set:
NLS_LANGUAGE = "AMERICAN"
NLS_TERRITORY = "AMERICA"
NLS_CHARACTERSET = "ZHS16GBK"
Processing table LIXIA.T10
***********************************************************************
* ** Run Time Statistics ** *
***********************************************************************
Report at 2015-11-18 23:12:44 (activity since 2015-11-18 23:12:25)
Output to REPINIT:
From Table LIXIA.T10:
# inserts: 108654
# updates: 0
# deletes: 0
# discards: 0
REDO Log Statistics
Bytes parsed 0
Bytes output 29620233
GGSCI (oradb) 54> info extract *,tasks
EXTRACT EXTINIT Last Started 2015-11-18 23:12 Status STOPPED
Checkpoint Lag Not Available
Log Read Checkpoint Table LIXIA.T10
2015-11-18 23:12:44 Record 108654
Task SOURCEISTABLE
源端OGG日志
2015-11-18 23:12:25 INFO OGG-00993 Oracle GoldenGate Capture for Oracle, extinit.prm: EXTRACT EXTINIT started.
2015-11-18 23:12:44 INFO OGG-00991 Oracle GoldenGate Capture for Oracle, extinit.prm: EXTRACT EXTINIT stopped normally.
在源端启动投递进程
GGSCI (oradb) 56> view params DPMP01
extract dpmp01
passthru
rmthost 192.168.222.154,mgrport 7809
rmttrail ./dirdat/td
--exttrail ./dirdat/tt
table lixia.*;
GGSCI (oradb) 24> start EXTRACT DPMP01
Sending START request to MANAGER ...
EXTRACT DPMP01 starting
在目标端启动复制进程
GGSCI (fmsserver) 2> edit params REPL
replicat repl
userid ggs,password ggs
HANDLECOLLISIONS
ASSUMETARGETDEFS
discardfile ./dirrpt/repl.dec,purge
map lixia.demo,target lixia.demo;
map lixia.t10,target lixia.t10;
GGSCI (fmsserver) 4> start REPL
REPLICAT REPL is already running.
查看目标端复制进程状态,直到大大于 load结束的时间
GGSCI (fmsserver) 8> info REPL
REPLICAT REPL Last Started 2015-11-18 22:53 Status RUNNING
Checkpoint Lag 00:00:00 (updated 00:00:07 ago)
Process ID 71838
Log Read Checkpoint File ./dirdat/td000008
2015-11-18 23:14:02.909934 RBA 54073 --查看这个时间
查看源端T10表的记录数和目标端的T10表记录数一致。
关闭目标端复制进程的数据冲突检查
GGSCI (fmsserver) 10> send replicat repl,NOHANDLECOLLISIONS
Sending NOHANDLECOLLISIONS request to REPLICAT REPL ...
REPL No tables found matching * to set NOHANDLECOLLISIONS.
去掉目标端复制进程参数文件中的数据冲突检查
GGSCI (fmsserver) 11> edit params repl
replicat repl
userid ggs,password ggs
--HANDLECOLLISIONS
ASSUMETARGETDEFS
discardfile ./dirrpt/repl.dec,purge
map lixia.demo,target lixia.demo;
map lixia.t10,target lixia.t10;
来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/21582653/viewspace-1843361/,如需转载,请注明出处,否则将追究法律责任。
转载于:http://blog.itpub.net/21582653/viewspace-1843361/