Help required!!.
Requirement
I have a StoredProc it returns the 10 Million records. In this case 10 Million records it may increase/decrease..
So in this scenario,we need create a SSIS Package for multiple csv files.
In this Ex .if 10Million Records then 10 csv files, each file should create with 1 million records
done as below, its working fine but taking more time.
steps:
--------
1. Script Task: is used to generate the Folder path with date and time
2.file system Task:Create Folder if Doesn't Exists based on script task file path.
3.Data Flow Task
a.Flat File Source to be set it up
b.Script Component:here i am using SP to return the results based on results, i am splitting the main result table to 10 tables(each table contains 1million records) and looping through the 10 tables.
c.In that loop we are creating the csv file based on that table.
Working as expected but its very long time to create 10 csv files .so wanted to check if any other scenario's. Please help on this.
Thanks,
Murali