Retriving large amount of data from WCF Service

Question

0.00/5 (No votes)

See more:

Hi All, I am building WCF service (hosted on IIS) that retrieves nearly 2,50,000 records from database. Currently I am trying with basicHttpBinding and wsHttpBinding binding but getting following errors 'Connection was closed forcefully' or 'An error occurred while receiving the HTTP response to http://localhost:8093/Service.svc. This could be due to the service endpoint binding not using the HTTP protocol. This could also be due to an HTTP request context being aborted by the server (possibly due to the service shutting down). See server logs for more details' I googled it and try different options like incresing maxBufferSize, maxReceivedMessageSize, using readerQuotas, also sets maxItemsInObjectGraph in dataContractSerializer etc etc but none of these help me. Please reply with the solution.
Can JSON help me in this scenario?

Posted 5-Sep-13 18:25pm

Umesh AP

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Nitin Singh India · Answer 1 · 2013-09-07T00:02:00

Your issue is more about the overall design rather than of WCF.
Retrieving such a huge dataset at one go will obviously overload the entire infrastructure, from memory to bandwidth.

However if you really want to do so, setup a chunking channel wherein the service will fetch the data in small chunks, say 10K records so you need buffer for only this much. The service will have the connection till the entire operation gets completed, whereas buffer overrun / timeout will not happen.

Following links explain the concept in more detail.

msdn.microsoft.com/en-us/library/aa717050.aspx
stackoverflow.com/questions/323585/wcf-chunking-streaming
http://mark-csharp.blogspot.in/2009/01/wcf-file-transfer-streaming-chunking.html