.CSV file and SSIS package in SQL Server

Question

0.00/5 (No votes)

See more:

I have to create an SSIS package to automate the migration of data from a .csv file format to the SQL Server. But my .csv file contains a lot of information ( initial status information about wireless sensors ) before the data in the tables that I actually need to work with. Since the entire process has to be automated, I am wondering if there is any way I could bypass/ignore the useless information and directly get to the data in the .csv file. So that I don't need to manually take off the information and create a new .csv file each time and then create a new SSIS package for it.

Posted 24-Mar-11 21:16pm

beginner1984

Add a Solution

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Corporal Agarn · Answer 1 · 2011-03-25T07:51:00

Solution 1

Set up a stored procedure that takes in all data then only saves to the final table the records you want.

A better way would be to use a .NET interface to automate the trim.

Posted 25-Mar-11 7:51am

Corporal Agarn

Updated 25-Mar-11 7:52am

v2

Wendelius · Answer 2 · 2011-03-25T08:13:00

Solution 2

Hi,

You could use OPENROWSET[^] in the SSIS package to read the data from the file. If the amount of non-interesting rows is known you can define how many rows are skipped in the beginning. The same can be done using bcp[^] if that's more suitable.

Posted 25-Mar-11 8:13am

Wendelius