How to split a large datatable into multiple datatables in asp.net with c#?

Question

0.00/5 (No votes)

See more:

How to split a large datatable into multiple datatables in asp.net with c#?
In datatable there are around 4 lakh records. On filling it fully to the datatable out of memory exception comes. So wants to process bulk data fetched in chunks of data.

Posted 14-May-14 22:12pm

Rahul 105

Add a Solution

Comments

Vi(ky 15-May-14 4:16am

you should fetch only number of records at a time instead of all records.

syed shanu 15-May-14 4:18am

Use dataview and filter with your key words

3 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

SRS(The Coder) · Answer 1 · 2014-05-14T22:47:00

Just get the total number of records and decide in how many pages you want to divide it.
Now pass the pageSize and pageNumber as parameter to procedure each time you fetch.

Because if you will fetch at a time no way you can handle the out of memory exception because you have to put it in memory before use. So retrieve data page wise only.

Telstra · Answer 2 · 2014-05-15T00:24:00

Solution 2

Refer

How to divide the data from one Datatable to two separate Datatable?[^]

http://stackoverflow.com/questions/12740353/split-a-datatable-into-2-or-more-datatables-based-on-column-value[^]

Posted 15-May-14 0:24am

Telstra

Maciej Los · Answer 3 · 2014-05-15T00:46:00

Solution 3

I'd suggest to read this: Tutorial 25: Efficiently Paging Through Large Amounts of Data[^]

Posted 15-May-14 0:46am

Maciej Los