OBIA 7.9.6.4 Full & Incremental  Loading

What is Full Load

·         Full load means loading data for the very first time into the BI Apps Datawarehouse.

·         Full load is also undertaken when data seems corrupt and needs to be cleaned again.

·         Data extracted is of huge volume and ETL mappings might run for long duration, often a few days …

·         Data volume controlled by INITIAL EXTRACT DATE parameters.

·         Some developers feel full load is the solution to just about any problem, which is incorrect.

What is Incremental Load

·         This is the load which customers generally run each day.

·         Only the incremental changes in source, compared to previous load are captured and loaded.

·         Data volume is low.

·         The Incremental Data Set or the Delta Data is determined mostly by LAST EXTRACT DATE parameter.

·         Logic and Calculations.

o      Delta Data = Current source data – Current Warehouse Data

o      Delta Data = Source record change/insert date > Last ETL Extract Date

o      Delta Data = New records + Existing Changed records

o      New records Inserted, Changed records updated ( in Warehouse)