如何解决Oracle GoldenGate 没有主键的问题?
本站文章除注明转载外,均为本站原创: 转载自love wife & love life —Roger 的Oracle技术博客
本文链接地址: 如何解决Oracle GoldenGate 没有主键的问题?
针对没有主键的情况,GoldenGate大概提供了3种方案,大致如下:
1、默认使用所有列当主键,通过keycols来实现,这种其实存在一定的问题,在这次的项目中直接否定。
2、通过在源端表中添加ogg_key_id列的方式来实现,这可能会影响应用,因此也直接否定。
3、通过在目标端的表中添加rowid类型的伪列,来实现。通过测试,发现这种相对靠谱,如下是我的测试过程.
我这里测试的ogg抽取9208 Dataguard standby,同步到10205的例子。另外,我们这里9i的环境和10g环境均在同一个主机.
1、源端
说明:这里我模拟的是9i环境超过32列的情况.
—创建测试表
SQL> conn roger/roger
Connected.
SQL> create table t_ALL_TABLES as select * from sys.ALL_TABLES where 1=2;
Table created.
—源端OGG配置
GGSCI (killdb.com) 2> view param ext_std
extract ext_std
userid ggs@killdb,password ggs
tranlogoptions archivedlogonly
tranlogoptions altarchivelogdest /home/ora9/arch_s
exttrail /home/ora9/ggs/dirdat/ra
discardfile ./dirrpt/exta.dsc,append, megabytes 500
fetchoptions USEROWID
table roger.t_all_tables, tokens (TKN-ROWID = @GETENV ("RECORD", "rowid")) keycols (owner) ;
table roger.t_buffer;
GGSCI (killdb.com) 3> view param dp1
EXTRACT dp1
RMTHOST 192.168.109.12, MGRPORT 7809 TCPBUFSIZE 5000000
PASSTHRU
RMTTRAIL ./dirdat/r1
NUMFILES 3000
TABLE roger.*;
GGSCI (killdb.com) 5> dblogin userid ggs@killdb,password ggs
Successfully logged into database.
GGSCI (killdb.com) 6> add trandata roger.t_all_Tables cols(owner) nokey
2014-12-17 01:49:59 WARNING OGG-00869 No unique key is defined for table T_ALL_TABLES. All viable columns will be used to represent the key, but may not guarantee uniqueness. KEYCOLS may be used to define the key.
Logging of supplemental redo data enabled for table ROGER.T_ALL_TABLES.
2. 目标端
—创建测试表
www.killdb.com>create table t_all_tables as select * from sys.all_tables where 1=2;
Table created.
www.killdb.com>alter table t_all_Tables drop column STATUS ;
Table altered.
www.killdb.com>alter table t_all_Tables drop column DROPPED;
Table altered.
www.killdb.com>alter table t_all_tables add (row_id rowid);
Table altered.
www.killdb.com> alter table roger.t_all_Tables add constraint t_all_tables_pk unique (row_id) enable;
Table altered.
—目标端OGG配置
GGSCI (killdb.com) 2> view param rep6
replicat rep6
userid ggs@Roger,password AADAAAAAAAAAAADAKHEJYIFGVAKDPFZBGDFJNEQBBJRISJAAOCHHZEWCEFTCRIRCJDSHUHAJZBFDZEWC,encryptkey kasaur_key
reperror default, discard
discardfile ./dirrpt/rep6.dsc, append, megabytes 50
handlecollisions
assumetargetdefs
----allownoopupdates
numfiles 3000
map roger.t_buffer, target roger.t_buffer;
map roger.t_all_tables , target roger.t_all_tables colmap (usedefaults, row_id = @token ("TKN-ROWID")) keycols (row_id);
3. 启动进程
–源端
GGSCI (killdb.com) 5> info all
Program Status Group Lag Time Since Chkpt
MANAGER RUNNING
EXTRACT RUNNING DP1 00:00:00 00:00:07
EXTRACT RUNNING EXT_STD 00:00:00 00:00:07
—目标端
GGSCI (killdb.com) 3> info all
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
JAGENT STOPPED
EXTRACT ABENDED DP1 00:00:00 568:19:49
EXTRACT ABENDED EXT1 00:00:00 309:16:06
REPLICAT STOPPED REP5 00:00:00 596:25:54
REPLICAT RUNNING REP6 00:00:00 00:00:02
4. 源端插入测试数据
模拟insert:
–源端
SQL> insert into t_all_Tables select * from sys.all_Tables where rownum < 11;
10 rows created.
SQL> commit;
Commit complete.
SQL> alter system switch logfile;
System altered.
SQL>
—-目标端
www.killdb.com>select count(1) from t_all_Tables;
COUNT(1)
----------
10
www.killdb.com>select owner,table_name,row_id from t_all_Tables;
OWNER TABLE_NAME ROW_ID
------------------------------ ------------------------------ ------------------
SYS SEG$ AAAH3QAABAAAV0yAAA
SYS CLU$ AAAH3QAABAAAV0yAAB
SYS OBJ$ AAAH3QAABAAAV0yAAC
SYS FILE$ AAAH3QAABAAAV0yAAD
SYS COL$ AAAH3QAABAAAV0yAAE
SYS CON$ AAAH3QAABAAAV0yAAF
SYS PROXY_DATA$ AAAH3QAABAAAV0yAAG
SYS USER$ AAAH3QAABAAAV0yAAH
SYS IND$ AAAH3QAABAAAV0yAAI
SYS FET$ AAAH3QAABAAAV0yAAJ
10 rows selected.
模式delete:
–源端
SQL> delete from t_all_tables where rownum < 5;
4 rows deleted.
SQL> commit;
Commit complete.
SQL> alter system switch logfile;
System altered.
SQL> select count(1) from t_all_tables;
COUNT(1)
----------
6
SQL> select owner,table_name,rowid from t_all_tables;
OWNER TABLE_NAME ROWID
------------------------------ ------------------------------ ------------------
SYS COL$ AAAH3QAABAAAV0yAAE
SYS CON$ AAAH3QAABAAAV0yAAF
SYS PROXY_DATA$ AAAH3QAABAAAV0yAAG
SYS USER$ AAAH3QAABAAAV0yAAH
SYS IND$ AAAH3QAABAAAV0yAAI
SYS FET$ AAAH3QAABAAAV0yAAJ
6 rows selected.
—目标端:
www.killdb.com>select count(1) from t_all_Tables;
COUNT(1)
----------
6
www.killdb.com>select owner,table_name,row_id from t_all_Tables;
OWNER TABLE_NAME ROW_ID
------------------------------ ------------------------------ ------------------
SYS COL$ AAAH3QAABAAAV0yAAE
SYS CON$ AAAH3QAABAAAV0yAAF
SYS PROXY_DATA$ AAAH3QAABAAAV0yAAG
SYS USER$ AAAH3QAABAAAV0yAAH
SYS IND$ AAAH3QAABAAAV0yAAI
SYS FET$ AAAH3QAABAAAV0yAAJ
6 rows selected.
www.killdb.com>
模拟update:
—源端:
SQL> select owner,table_name,rowid from t_all_tables;
OWNER TABLE_NAME ROWID
------------------------------ ------------------------------ ------------------
SYS COL$ AAAH3QAABAAAV0yAAE
SYS CON$ AAAH3QAABAAAV0yAAF
SYS PROXY_DATA$ AAAH3QAABAAAV0yAAG
SYS USER$ AAAH3QAABAAAV0yAAH
SYS IND$ AAAH3QAABAAAV0yAAI
SYS FET$ AAAH3QAABAAAV0yAAJ
6 rows selected.
SQL> update t_all_tables set owner='killdb.com' where table_name='COL$';
1 row updated.
SQL> update t_all_tables set owner='killdb.com' where rowid='AAAH3QAABAAAV0yAAF';
1 row updated.
SQL> commit;
Commit complete.
SQL> alter system switch logfile;
System altered.
SQL> select owner,table_name,rowid from t_all_tables;
OWNER TABLE_NAME ROWID
------------------------------ ------------------------------ ------------------
killdb.com COL$ AAAH3QAABAAAV0yAAE
killdb.com CON$ AAAH3QAABAAAV0yAAF
SYS PROXY_DATA$ AAAH3QAABAAAV0yAAG
SYS USER$ AAAH3QAABAAAV0yAAH
SYS IND$ AAAH3QAABAAAV0yAAI
SYS FET$ AAAH3QAABAAAV0yAAJ
6 rows selected.
–目标端:
www.killdb.com> select owner,table_name,row_id from t_all_Tables;
OWNER TABLE_NAME ROW_ID
------------------------------ ------------------------------ ------------------
killdb.com COL$ AAAH3QAABAAAV0yAAE
killdb.com CON$ AAAH3QAABAAAV0yAAF
SYS PROXY_DATA$ AAAH3QAABAAAV0yAAG
SYS USER$ AAAH3QAABAAAV0yAAH
SYS IND$ AAAH3QAABAAAV0yAAI
SYS FET$ AAAH3QAABAAAV0yAAJ
6 rows selected.
www.killdb.com>
我们可以看到ogg完全是可以支持利用构造rowid伪列的方式来解决没有主键的问题。 然而这种方法
也有一个很大的问题:迁移之后,新环境中的row_id 伪列需要进行drop,这个drop的动作是非常坑爹的。
例如我们客户这里的系统,均为2.5TB以上的,最大12TB的库,那么drop column就疯掉了。
About Me
...............................................................................................................................
● 本文转载自:http://www.killdb.com/2014/12/18/%E5%A6%82%E4%BD%95%E8%A7%A3%E5%86%B3oracle-goldengate-%E6%B2%A1%E6%9C%89%E4%B8%BB%E9%94%AE%E7%9A%84%E9%97%AE%E9%A2%98%EF%BC%9F.html
● 本文在itpub(http://blog.itpub.net/26736162)、博客园(http://www.cnblogs.com/lhrbest)和个人微信公众号(xiaomaimiaolhr)上有同步更新
● 本文itpub地址:http://blog.itpub.net/26736162/abstract/1/
● 本文博客园地址:http://www.cnblogs.com/lhrbest
● 本文pdf版及小麦苗云盘地址:http://blog.itpub.net/26736162/viewspace-1624453/
● 数据库笔试面试题库及解答:http://blog.itpub.net/26736162/viewspace-2134706/
● QQ群:230161599 微信群:私聊
● 联系我请加QQ好友(646634621),注明添加缘由
● 于 2017-07-01 09:00 ~ 2017-07-31 22:00 在魔都完成
● 文章内容来源于小麦苗的学习笔记,部分整理自网络,若有侵权或不当之处还请谅解
● 版权所有,欢迎分享本文,转载请保留出处
...............................................................................................................................
拿起手机使用微信客户端扫描下边的左边图片来关注小麦苗的微信公众号:xiaomaimiaolhr,扫描右边的二维码加入小麦苗的QQ群,学习最实用的数据库技术。
来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/26736162/viewspace-2141852/,如需转载,请注明出处,否则将追究法律责任。
转载于:http://blog.itpub.net/26736162/viewspace-2141852/