Click here to Skip to main content
       

Database

 
AnswerRe: MS SQL - Tinyint - Default Value PinmemberJammoD8716-Nov-12 22:30 
QuestionStaging Area PinmemberPhanindra26115-Nov-12 9:05 
AnswerRe: Staging Area Pinmembermark merrens15-Nov-12 9:37 
GeneralRe: Staging Area PinmemberPhanindra26116-Nov-12 0:14 
GeneralRe: Staging Area Pinmembermark merrens16-Nov-12 7:58 
QuestionRe: Staging Area PinmemberPhanindra26116-Nov-12 8:11 
AnswerRe: Staging Area Pinmembermark merrens16-Nov-12 8:34 
AnswerRe: Staging Area PinmemberMycroft Holmes16-Nov-12 15:20 
We do it somewhat different to Mark, our staging table are exact replicas of the source data, this allows us to use Bulk Copy when loading the data. It also insures there are no errors in the Load part of the ELT process.
 
We then use stored procedures to do the transforms to the production format (these may also be staging tables in some solutions). The major benefit is that you are doing any transforms on a limited data set and it is easy to debug the procedure. It then becomes a simple matter to dump in the staging data to the production tables.
 
I find a well crafted ELT process leave any ETL application in the dust. There are some ETL apps that this may not apply to but the cost is extraordinary.
Never underestimate the power of human stupidity
RAH

GeneralRe: Staging Area PinmemberS Douglas27-Nov-12 19:38 
GeneralRe: Staging Area PinmemberMycroft Holmes27-Nov-12 20:31 
GeneralRe: Staging Area PinmemberS Douglas29-Nov-12 7:52 
Questionfirst linq for entity frame work? PinmemberMember 875182715-Nov-12 1:02 
AnswerRe: first linq for entity frame work? Pinmemberdigimanus15-Nov-12 3:17 
QuestionBEGIN TRANSACTION AND COMMIT TRANSACTION Pinmembervanikanc14-Nov-12 7:40 
AnswerRe: BEGIN TRANSACTION AND COMMIT TRANSACTION PinmemberPhanindra26114-Nov-12 8:40 
QuestionFault Exception in WCF Services PinmemberPhanindra26114-Nov-12 6:15 
AnswerRe: Fault Exception in WCF Services PinmemberEddy Vluggen14-Nov-12 6:36 
GeneralRe: Fault Exception in WCF Services PinmemberPhanindra26114-Nov-12 8:05 
QuestionRelation multiple table using in C# PinmemberYBG13-Nov-12 2:53 
AnswerRe: Relation multiple table using in C# PinmemberPhanindra26114-Nov-12 8:23 
QuestionTrying to get a MySQL subquery to return multiple records PinmemberSQL Ed12-Nov-12 8:19 
AnswerRe: Trying to get a MySQL subquery to return multiple records PinmemberEddy Vluggen12-Nov-12 11:33 
QuestionSending data to database PinmemberPhanindra26111-Nov-12 19:03 
AnswerRe: Sending data to database Pinmemberjschell12-Nov-12 10:08 
AnswerRe: Sending data to database PinmemberMycroft Holmes12-Nov-12 12:51 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.


Advertise | Privacy | Mobile
Web02 | 2.8.140827.1 | Last Updated 1 Sep 2014
Copyright © CodeProject, 1999-2014
All Rights Reserved. Terms of Service
Layout: fixed | fluid