Click here to Skip to main content
14,549,480 members
Rate this:
Please Sign up or sign in to vote.
See more:
Dear All,
I need to know the maximum size of the csv file in which Oledbconnection can process in VB.NET Application, I can tested with the csv file which has more than 12,00,000 records, its fine. but if i give the csv file which has 1crore records then i got the out of memory exception. Please anyone help me to do this.

Regards,
BlueSathish
Posted

1 solution

Rate this:
Please Sign up or sign in to vote.

Solution 1

With a large file, it's better to read it in 'chunks' by using a StreamReader and buffering the data

Have a look at this article, which shows the technique (c#)

A Fast CSV Reader[^]

There isn't going to be a maximum file size per se, you will be limited by the resources available on the machine running the code.
   
Comments
bluesathish 24-Nov-11 7:40am
   
Thanks for your reply, I dont want to use StreamReader due to some internal restriction. I'm asking the Maximum size of CSV file in which the Oledbconnection can process. Can you Give me the solution for it?

Regards,
bluesathish
Dylan Morley 24-Nov-11 7:40am
   
There isn't going to be a maximum file size per se, you will be limited by the resources available on the machine running the code.
bluesathish 24-Nov-11 7:47am
   
oh ok thanks, then can you guess what will be the max file size if i run the application on the machine which has 2GB RAM, 2.85Ghz Processor and More than 5GB Page file Size.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)




CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100