Fact Data increamental Load
Hi All, I need your thoughts here, basically I have DW where we have a Staging and Fact database. We nee do load the increamental Fact data for the cube. The fact data source is a ERP system. The most of the measures are calculated columns with some business logic involved with it. They are not directly a source Table field value. I was wondering how I should load the increamental Fact data in the cube. Here is the approach I was thinking 1. Pull the source Tables from source to Staging which are used for the Fact data 2. Use lookups while pulling the data from source to staging so that we know what all new records are 3. Once all the source tables are available in Staging then create stored procedures to calculate the measure. 4. Store these measures in Staging by creating the same copy of Fact table in Staging area also. 5. Once the data is availabe in staging Fact table then move to Fat Table in Fact database. Please let me know your thoughts on this?Thanks, Gaurav http://gauravsqlserver.blogspot.com
May 4th, 2011 10:20am

Hello Gaurav, I highly recommend you look into a post by Andy Leonard SSIS Design Pattern - Incremental Loads http://sqlblog.com/blogs/andy_leonard/archive/2007/07/09/ssis-design-pattern-incremental-loads.aspxArthur My Blog
Free Windows Admin Tool Kit Click here and download it now
May 4th, 2011 10:30am

also here http://vsteamsystemcentral.com/cs21/blogs/applied_business_intelligence/archive/2007/05/21/ssis-design-pattern-incremental-loads.aspxhttp://uk.linkedin.com/in/ramjaddu
May 4th, 2011 11:22am

This topic is archived. No further replies will be accepted.

Other recent topics Other recent topics