oracle odi ogg 同步转化数据

Integrating Oracle Data Integrator 12c (ODI) and Oracle GoldenGate 12c (OGG)

Expand All Topics Hide All Media Print

Topic Listclose

• 正在上传…重新上传取消 Overview
• 正在上传…重新上传取消 1. Prepare the Databases
  • 正在上传…重新上传取消 1.1 Prepare Source database
  • 正在上传…重新上传取消 1.2 Prepare Staging database
  • 正在上传…重新上传取消 1.3 Prepare Target database
• 正在上传…重新上传取消 2. Prepare the GoldenGate Instances
  • 正在上传…重新上传取消 2.1 Prepare Source GoldenGate
  • 正在上传…重新上传取消 2.2. Prepare Target GoldenGate
• 正在上传…重新上传取消 3. Prepare ODI Environment
  • 正在上传…重新上传取消 3.1 Prepare ODI Agents
  • 正在上传…重新上传取消 3.2 Prepare ODI Data Servers
  • 正在上传…重新上传取消 3.3 Prepare ODI Models
  • 正在上传…重新上传取消 3.4 Initial Load of the Staging Table
  • 正在上传…重新上传取消 3.5 Initial Load of the Target Table
• 正在上传…重新上传取消 4. Configure GoldenGate Processes
  • 正在上传…重新上传取消 4.1 Configure OGG Extract and Datapump via ODI
  • 正在上传…重新上传取消 4.2 Configure OGG Replicat via ODI
  • 正在上传…重新上传取消 4.3 Start OGG Processes via GGSCI
• 正在上传…重新上传取消 5. Configure ODI Designer
  • 正在上传…重新上传取消 5.1 Configure ODI Change Data Capture (CDC)
  • 正在上传…重新上传取消 5.2 Configure ODI Mappings
  • 正在上传…重新上传取消 5.3 Configure ODI Packages
• 正在上传…重新上传取消 6. Test Everything
  • 正在上传…重新上传取消 6.1 Check BEFORE views of OGG processes and the tables
  • 正在上传…重新上传取消 6.2 Do DML on source data
  • 正在上传…重新上传取消 6.3 Check OGG processes
  • 正在上传…重新上传取消 6.4 Check AFTER views of the tables
• 正在上传…重新上传取消 7. Cleanup
  • 正在上传…重新上传取消 7.1 Cleanup ODI
  • 正在上传…重新上传取消 7.2 Cleanup OGG
• 正在上传…重新上传取消 Summary

 

Overview

Purpose

This tutorial covers integrating Oracle Goldengate (OGG) with Oracle Data Integrator 12c (ODI). ODI knows about and can control OGG, OGG does not know about ODI.

Time to Complete

Approximately 2 hours, depending on whether you use the pre-built VM or not (see Software Requirements below).

Introduction

In this tutorial, you will create the sample database users and tables, configure the OGG manager and agents, configure the ODI data servers, models, datastores, maps, agents, and packages, and then start/stop/control the processes. There will be both OGG replication (capture and delivery) and ODI replication (Change Data Capture via Journaling). The OGG will run near-real-time, the ODI will run in micro-batches of one row of changed data polling once/second.

Scenario

Suppose the Example Corporation has an Orders Application system that has a Customer table. You want to keep an up-to-date copy of that information on the Sales administration system. As changes are made to the Orders Customer table, OGG in near-real-time replicates those changes to the Sales Customer table. However, the Sales system requires the format of the data to be transformed into a slightly different layout. ODI will do the transformation of only the rows that have changed.

When showing terminal sessions of the above scenario, the logical and physical E-LT flow will be as follows:

• Source will be the Orders Application OGG_ODI_DEMO_SRC.OGG_CUSTOMER table shown with a BLUE banner.
• Staging will be the Sales Administration ODI_DEMO.OGG_CUSTOMER table shown with a RED banner.
• Target will be the Sales Administration ODI_DEMO.TRG_CUSTOMER table shown with a GREEN banner.

Hardware and Software Requirements

There are two ways you can do this tutorial: either install all the software yourself on your own host(s), or use a virtual machine (VM) with most everything pre-installed. The advantage of the VM is, of course, that it is easier and faster, but it may not exactly represent your final environment, in which case you may want to go through the extra steps to install everything yourself. The tutorial will assume you are using the VM, but will include some of the extra steps for the recreating preinstalled bits.

The following is a list of hardware and software requirements:

• Hardware
  • If you are using the VM, it requires 4 GB itself, usually hosted on a PC with 8 GB total. The VM assumes a host PC with 4 CPUs; you may need to adjust that down if you have fewer real CPUs. The VM works fine with 2 CPUs.
  • If you are running the software on a real host(s), you need enough RAM to support the processes. If you have multiple hosts, the RAM can be distributed per host.
    • Each DB requires at least 1 GB (Enterprise Edition (EE) may require 2 GB)
    • Each OGG instance requires at least 1 GB
    • ODI requires at least 1 GB
    • The OS requires at least 1 GB. More is better.
  • Enough disk to support the installs, including unzipping the images.
• Software
  • If you are using the VM, you will need:
    • The Oracle VirtualBox player
    • The VM image (approx 9 GB)
    • The demo VM Getting Started with ODI 12c guide.
  • If you are installing the software yourself in Standalone mode, you will need:
    • Three heterogeneous databases (ideally). For example, the source could be MySQL, the staging could be Oracle 11g XE, the target could be Oracle 12c EE version 12.1. In this VM, the single database is Oracle 11g EE version 11.2.0.4.
    • Two identical copies of Oracle GoldenGate. In this example, the tutorial is using version is 12.1.2.0.0.
    • One Oracle Data Integrator. In this example, the tutorial is using version is 12.1.3.
    • Two copies of Java: the one that comes with OGG (for the JAgent), and JDK version 1.7.0_15 or higher for the ODI Agent.
    • An OS. In this example, the tutorial is using Oracle Enterprise Linux (64-bit) 2.6.32-300.39.5
  • Optional software to install in Java EE mode (not present in the VM):
    • One Oracle WebLogic Server 12c. This affects how the ODI Agents are deployed. The VM is not using WLS.

Prerequisites

Before starting this tutorial, you should:

• Have access to or have installed Oracle Data Integrator 12c. The prerequisites for that are a FMW home with WLS installed, a database with RCU configured to create the ODI repositories.
• Have access to or have installed sample schemas and repositories. This example uses the ODI_DEMO schema which is available online at: ODI Getting Started. If you are using the VM, then this schema is already included.

 

1. Prepare the Databases

 

2. Prepare the GoldenGate Instances

 

3. Prepare ODI Environment

 

4. Configure GoldenGate Processes

 

5. Configure ODI Designer

 

6. Test Everything

 

7. Cleanup

 

Summary

Help OLL About Oracle Contact Us Terms of Use