We are currently in the process of recommending a testing strategy for one of our clients related to their enterprise DW project including 10-15 major ETL feeds.
I wanted to ping this group to see how either with-in group, we have implemented automated (not web based manual) unit testing the ETL code (either SSIS packages or other tools like Informatica).
Their current approach includes executing any data intensive "data flows" in the stored procedure layer as external tasks and they use nANT for all their internal testing.
We have come up with few options based on their existing infrastructure/toolset, but, wanted to get some input from folks who have project experience.
1. Use sqlunit to automate unit testing of stored procedures used in the data flows
2. Use nANT to execute SSIS packages with "golden test data" as end-to-end tests
If anyone has experience developing automated unit tests for ETL projects, please share your approach |
|