Oracle21c GoldenGate官网介绍

Oralce GoldenGate介绍官网地址：
Understanding Oracle GoldenGate

---

OGG 的通用组件包括extract(抽取进程), trail(足迹文件), replicat(复制进程) 三个组件，同步过程大致为extract 抽取数据源端日志记录中的dml和ddl操作写进trail 中，replicat读取trail并生成dml和ddl语句，在目标端执行相应的sql语句。

---

Oracle GoldenGate is a comprehensive software package for real-time data integration and replication. It enables high availability solutions, real-time data integration, transactional change data capture, data replication, transformations, and verification between operational and analytical enterprise systems.
OGG是一个全面的实时数据集成和复制软件。在操作型（OLTP）和分析型（OLAP）企业系统中，OGG能够应用于高可用解决方案、实时数据集成、捕获事务变更数据、数据复制、转换和验证。

• Data movement is in real-time, reducing latency.
  数据复制是实时的，低延迟性的。
• Only committed transactions are moved, enabling consistency and improving performance.
  只有提交的事务数据会被复制，确保数据一致性和提高复制性能。
• Different versions and releases of Oracle Database are supported along with a wide range of heterogeneous databases running on a variety of operating systems. You can replicate data from an Oracle Database to a different heterogeneous database.
  OGG支持运行在多种操作系统上的不同发行版本的Oralce数据库管理系统和其他不同架构的数据库管理系统之间的数据复制。
• Simple architecture and easy configuration.
  OGG的简单架构和简易配置。
• High performance with minimal overhead on the underlying databases and infrastructure.
  运行在数据库管理系统等基础设施之上OGG可以保持高性能且最小化开支。

• Business Continuity and High Availability
  业务数据连续性和高可用性
  Business Continuity is the ability of an enterprise to provide its functions and services without any lapse in its operations. High Availability is the highest possible level of fault tolerance. To achieve business continuity, systems are designed with multiple servers, multiple storage, and multiple data centers to provide high enough availability to support the true continuity of the business. To establish and maintain such an environment, data needs to be moved between these multiple servers and data centers, which is easily done using Oracle GoldenGate.
  业务连续性是一家企业在经营活动中提供不间断的功能和服务的一种能力。高可用性是最高级别的故障容忍度。为确保业务连续性，系统被设计成多服务器的、多存储的、多数据中心的，以提供足够高的（容灾）能力去支持真实环境下的业务连续性。为了建立和维护这样的一个环境，数据必须在多个服务器和数据中心之间传输，而这种工作任务是OGG 所擅长的。
• Initial Load and Database Migration
  原始数据加载（初始化数据）和数据库迁移
  Initial load is a process of extracting data records from a source database and loading those records onto a target database. Initial load is a data migration process that is performed only once. Oracle GoldenGate allows you to perform initial load data migrations without taking your systems offline.
  原始数据加载是只执行一次的、从源端数据库抽取数据记录并加载这些记录到目标数据库的一个数据迁移过程。OGG允许无需停机并在线执行原始数据加载任务。
• Data Integration
  数据集成
  Data integration involves combining data from several disparate sources, which are stored using various technologies, and provide a unified view of the data. Oracle GoldenGate provides real-time data integration.
  OGG 数据集成可以组合不同来源、使用不同的技术存储的数据，并且对集成后的数据提供统一视角。OGG提供实时的数据集成。

Extract，Trail，Replicat 抽取进程，足迹文件和复制进程

• Extract is a process that is configured to run against the source database or configured to run on a downstream mining database (Oracle only) with capturing data generated in the true source database located somewhere else. This process is the extraction or the data capture mechanism of Oracle GoldenGate.
  抽取进程是用于捕获任意部署位置的源数据库中生成的数据。这个进程是OGG实施数据抽取或者数据捕获的机制。
  可以配置抽取进程用于以下情况：

  • Initial Loads: When you set up Oracle GoldenGate for initial loads, the Extract process captures the current, static set of data directly from the source objects.
    当OGG被使用于进行初始化数据加载，抽取进程是直接从数据源捕获当前的，静态的数据集。
  • Change Synchronization: When you set up Oracle GoldenGate to keep the source data synchronized with another set of data, the Extract process captures the DML and DDL operations performed on the configured objects after the initial synchronization has taken place. Extracts can run locally on the same server as the database or on another server using the downstream Integrated Extract for reduced overhead. It stores these operations until it receives commit records or rollbacks for the transactions that contain them. If it receives a rollback, it discards the operations for that transaction. If it receives a commit, it persists the transaction to disk in a series of files called a trail, where it is queued for propagation to the target system. All the operations in each transaction are written to the trail as a sequentially organized transaction unit and are in the order in which they were committed to the database (commit sequence order). This design ensures both speed and data integrity.
    当OGG被使用于保持数据源数据集和目标数据集的一致性，在初始化数据加载之后，抽取进程捕获在配置文件中配置的对象的DML和DDL操作。抽取进程可以运行在源数据库所在的服务器上或者其他下游的集成和归纳抽取服务器。进程保存这些DML和DDL操作直到收到包含这些操作的事务的提交指令或者回滚指令。如果进程收到回滚操作，则丢弃相关的事务操作日志。如果进程收到提交操作，则持久化事务操作日志到磁盘上的足迹文件（trail，有没有更好的翻译），这些足迹文件会被按顺序复制到目标系统。所有这些在不同事务中的操作（DML和DDL），会被按顺序且按照不同的事务单元记录在足迹日志中，而且会按照提交给数据库的顺序记录足迹日志。这种设计确保了抽取速度和数据集成。

  可以配置抽取进程为以下数据源类型：

  • Source tables: This source type is used for initial loads.
    数据源表：这种类型用于原始数据加载。
  • Database recovery logs or transaction logs: While capturing from the logs, the actual method varies depending on the database type. An example of this source type is the Oracle Database redo logs.
    数据库恢复日志或者事务日志：当从日志中捕获数据时，具体的日志依赖于具体的数据库管理系统。举个例子，在Oralce数据库管理系统中，是redo日志。

• A trail is a series of files on disk where Oracle GoldenGate stores the captured changes to support the continuous extraction and replication of database changes.
  足迹文件是一系列支持连续抽取和复制数据库变更的磁盘文件，用于保存OGG捕获的变更数据操作。
  A trail can exist on the source system, an intermediary system, the target system, or any combination of those systems, depending on how you configure Oracle GoldenGate. On the local system, it is known as an Extract trail (or local trail). On a remote system, it is known as a remote trail. By using a trail for storage, Oracle GoldenGate supports data accuracy and fault tolerance. The use of a trail also allows extraction and replication activities to occur independently of each other. With these processes separated, you have more choices for how data is processed and delivered. For example, instead of extracting and replicating changes continuously, you could extract changes continuously and store them in the trail for replication to the target later, whenever the target application needs them.
  足迹文件可以在源系统、在中间系统、在目标系统或者在这三种系统的组合中存在，取决于OGG是怎么被安装和配置的。在本地系统中，足迹文件就是抽取文件（或者本地足迹文件）。在远程系统中，足迹文件就是远程文件。通过使用足迹文件存储数据变更操作，OGG支持较高的数据的准确性和失误容忍度。使用足迹文件也能够使抽取进程和复制进程各自独立运行。这些进程分开独立运行的机制，使得更多的数据处理和分发方式可以被发现。举个例子，除了抽取进程和复制进程同时持续运行之外，可以配置抽取进程连续运行并保存抽取的数据在足迹文件中，但是可以配置复制进程在迟一些的时间运行，当目标数据库需要这些数据的时候。

  • Processes that Write to the Trail File: In Oracle GoldenGate Classic, the Extract and the data pump processes write to the trail. Only one Extract process can write to a given local trail. All local trails must have different full-path names though you can use the same trail names in different paths.
    写足迹文件的进程：在经典OGG场景中，写足迹文件的进程包括抽取进程和数据泵进程。只有一个抽取进程可以写一个提供的本地足迹文件。尽管在不同的路径下可以使用相同的足迹文件名称，所有的本地足迹文件必须有不同的绝对路径名称。
  • Processes that Read from the Trail File:The Replicat process reads the trail and applies the replicated DML and DDL operations to the target database.
    读足迹文件的进程：复制进程读取足迹文件并在目标数据库中执行足迹文件中记录的DML和DDL操作。（还有数据泵和分布式服务器会读取足迹文件，这里就不介绍了，感兴趣到官网翻。）
  • Trail File Creation and Maintenance:
    足迹文件的创建和维护：在各种进程的运行中，只要有需要就会创建足迹文件。足迹文件的命名和保留时间由参数控制：TRAIL_SEQLEN_9D | TRAIL_SEQLEN_6D，PURGEOLDEXTRACTS。
  • Converting Existing Trails to 9 Digit Sequence Numbers
    上一步，足迹文件的命名转换（6位和9位互换）。

• Replicat is a process that delivers data to a target database. It reads the trail file on the target database, reconstructs the DML or DDL operations, and applies them to the target database.
  复制进程是传输数据到目标数据库的进程。复制进程读取目标数据库的足迹文件，重构DML和DDL操作，并在目标数据库中执行重构后的SQL语句。

• The Replicat process uses dynamic SQL to compile a SQL statement once and then executes it many times with different bind variables. You can configure the Replicat process so that it waits a specific amount of time before applying the replicated operations to the target database. For example, a delay may be desirable to prevent the propagation of errant SQL, to control data arrival across different time zones, or to allow time for other planned events to occur.
  复制进程使用动态SQL去编译一次SQL声明并使用不同的绑定变量多次执行。可以配置复制进程一定的等待时间，这段时间过后才进行复制操作。举个例子，一段延迟是希望存在的，目的是为了防止有缺陷的SQL复制、控制不同时区的到达日期、或者允许空闲时间去启动其他计划事件。

  • Initial Loads: When you set up Oracle GoldenGate for initial loads, the Replicat process applies a static data copy to target objects or routes the data to a high-speed bulk-load utility.
    当OGG用于原始数据加载时，复制进程在目标对象中应用静态数据备份或者在高速批量加载功能中发送数据。
  • Change Synchronization: When you set up Oracle GoldenGate to keep the target database synchronized with the source database, the Replicat process applies the source operations to the target objects using a native database interface or ODBC, depending on the database type.
    当OGG用于在数据源和目标端中进行数据变更同步时，复制进程（通过原生数据库接口或者ODBC，这取决于数据库管理系统的类型）把源端的SQL操作应用到目标端中。

OGG架构包括传统架构（classic architecture）和微服务架构（microservices architecture），传统架构只支持到12C（12.3.0.1），在12C之后主流的OGG产品都是微服务架构。

传统架构：
官网示意图：

• Manager 管理进程
  • Manager is the control process of Oracle GoldenGate. Manager must be running on each system in the Oracle GoldenGate configuration before the Extract or Replicat processes can be started.
    管理进程控制OGG的进程（主要包括抽取进程和复制进程）。管理进程必须在抽取进程和复制进程启动之前启动。
  • Manager performs the following functions:
    管理进程主要执行一下功能：
    • Starts Oracle GoldenGate processes
      启动OGG的进程（主要是抽取进程和复制进程）。
    • Starts dynamic processes
      启动动态进程。
    • Maintains port numbers for processes
      维护进程端口数。
    • Purges Trail files based on retention rules
      根据保留规则刷新足迹日志文件。
    • Creates event, error, and threshold reports
      创建事件日志，错误日志和阈值报告。
• Data Pump 数据泵
  • Data pump is a secondary Extract group within the source Oracle GoldenGate configuration.
    数据泵是OGG原始配置的第二抽取进程。
  • If you configure a data pump, the Extract process writes all the captured operations to a trail file on the source database. The data pump reads the trail file on the source database and sends the data operations over the network to the remote trail file on the target database. Configuring a data pump is highly recommended for most configurations. If a data pump is not used, the Extract streams all the captured operations to a trail file on the remote target database. In a typical configuration with a data pump, however, the primary Extract group writes to a trail on the source system. The data pump reads this trail and sends the data operations over the network to a remote trail on the target. The data pump adds storage flexibility and also serves to isolate the primary Extract process from TCP/IP activity.
    如果配置了数据泵，抽取进程会在数据源端把所有捕获的数据操作记录到足迹日志文件中。数据泵读取数据源端的足迹日志文件，并通过网络把读取的内容发送到远程的目标端足迹日志文件。强烈推荐在OGG的配置中增加数据泵配置。如果数据泵没有配置，抽取进程会把所有捕获的数据操作传输到远程目标端足迹日志文件。然而，在有配置数据泵的情况下，抽取进程只会写数据源段的足迹日志文件。数据泵读取此足迹日志文件并通过网络传输到远程目标端足迹日志文件。数据泵的配置和使用让存储更加灵活，而且可以隔离抽取进程运行TCP/IP活动。
  • Though configuring a data pump is optional, Oracle recommends it for most configurations. Some reasons for using a data pump include the following:
    尽管数据泵是可选配置，Oracle推荐在多数OGG中配置数据泵。理由如下：
    • Protection against network and target failures
      在网络和目标端故障中提供保护机制。
    • You are implementing several phases of data filtering or transformation
      数据泵在数据的过滤和转换中提供不同的阶段。
    • Consolidating data from many sources to a central target
      抽取多个数据源的数据合并至一个中央目标端。
    • Synchronizing one source with multiple targets
      从一个数据源同步到多个目标端。
• Collector 收集器
  • The Collector is started by the manager process and is a process that runs in the background on the target system. It reassembles the transactional data into a target trail.
    收集器是由管理进程启动的，在目标端系统的后台中运行。收集器重组事务数据到目标端的足迹日志文件。
• GGSCI
  • You can use the Oracle GoldenGate Software Command Interface (GGSCI) commands to create data replications. This is the command interface between you and Oracle GoldenGate functional components.
    GGSCI命令可以用于创建数据复制。这是OGG的命令行交互界面。

微服务架构：
官网示意图：

微服务架构内容暂时消化不了。先放着。。。