What is the maximum size of CSV file in which the Oledbconnection can process in vb.net?

Question

0.00/5 (No votes)

See more:

Dear All,
I need to know the maximum size of the csv file in which Oledbconnection can process in VB.NET Application, I can tested with the csv file which has more than 12,00,000 records, its fine. but if i give the csv file which has 1crore records then i got the out of memory exception. Please anyone help me to do this.

Regards,
BlueSathish

Posted 24-Nov-11 1:04am

bluesathish

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Dylan Morley · Answer 1 · 2011-11-24T01:32:00

Solution 1

With a large file, it's better to read it in 'chunks' by using a StreamReader and buffering the data

Have a look at this article, which shows the technique (c#)

A Fast CSV Reader[^]

There isn't going to be a maximum file size per se, you will be limited by the resources available on the machine running the code.

Posted 24-Nov-11 1:32am

Dylan Morley

Comments

bluesathish 24-Nov-11 7:40am

Thanks for your reply, I dont want to use StreamReader due to some internal restriction. I'm asking the Maximum size of CSV file in which the Oledbconnection can process. Can you Give me the solution for it?

Regards,
bluesathish

Dylan Morley 24-Nov-11 7:40am

There isn't going to be a maximum file size per se, you will be limited by the resources available on the machine running the code.

bluesathish 24-Nov-11 7:47am

oh ok thanks, then can you guess what will be the max file size if i run the application on the machine which has 2GB RAM, 2.85Ghz Processor and More than 5GB Page file Size.