What is the difference between Full load and Incremental load

原创 2015年07月07日 14:42:14
In most OBIA projects we create both incremental and full load mappings for each tables in Date Warehouse target. Below you can find the difference between both.

Full Load is the entire data dump load taking place the very first time. In this we give the last extract date as empty so that all the data gets loaded

Incremental - Where difference between target and source data is dumped at regular intervals.Here we give the last extract date such that only records after this date are loaded.

Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
Full Load: Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded.
Incremental Load: Last_Extract_Date = The date from which you need the data (to get latest record).

Why Incremental:
  • Speed.
  • Preserving history

  • Full Load vs Incremental Load:


    Full Load
    Incremental Load
    Truncates all rows and loads from scratch.
    New records and updated ones are loaded
    Requires more time.
    Requires less time.
    Can easily be guaranteed
    Difficult. ETL must check for new/updated rows.
    Can be lost.
    Retained.

    版权声明:本文为博主原创文章,未经博主允许不得转载。

    相关文章推荐

    In SQL, what’s the difference between a full join and an inner join?

    A brief explanation of a joinLet’s start with a quick explanation of a join. Joins are used to combi...

    C++ String: What is the difference between '\n' and '\r\n'?

    C++ String: What is the difference between '\n' and '\r\n'? Q: What is the difference between...
    • yinzch
    • yinzch
    • 2011年12月08日 12:53
    • 148

    What is the difference between a definition and a declaration?

    原帖: http://stackoverflow.com/questions/1410563/what-is-the-difference-between-a-definition-and-a-dec...

    What is the difference between a thread and a process?

    Processes vs Threads This is a very common interview question that has been asked at ...

    What is the difference between a theorem, a lemma, and a corollary?

    Definition — a precise and unambiguous description of the meaning of a mathematical term.  It charac...

    What is the difference between a left outer join and a right outer join?

    It is best to illustrate the differences between left outer joins and right outer joins by use of an...

    What is the difference between getWidth/heigth() and getMeasuredWidth/Heigth() in Android SDK?

    From: http://stackoverflow.com/questions/8657540/what-is-the-difference-between-getwidth-heigth-and-...
    • fyfcauc
    • fyfcauc
    • 2014年10月11日 16:54
    • 386

    What is the difference between initWithCoder:, initWithNibName:, and awakeFromNib?

    initWithNibName:bundle: is a message sent to a view (or window) controller in order to create the co...

    What is the difference between BIT and TINYINT in MySQL

    What is the difference between BIT and TINYINT in MySQL? A TINYINT is an 8-bit integer value, a...

    what is the difference between ELF files and bin files

    [http://stackoverflow.com/questions/2427011/what-is-the-difference-between-elf-files-and-bin-files ...
    内容举报
    返回顶部
    收藏助手
    不良信息举报
    您举报文章:What is the difference between Full load and Incremental load
    举报原因:
    原因补充:

    (最多只允许输入30个字)