Click here to Skip to main content
Click here to Skip to main content

Threaded WebDownload class with Progress Call-backs

By , 19 Jul 2002
Rate this:
Please Sign up or sign in to vote.

Download in progress

Preface

Ever wanted your application to download something from the Internet? Here is an implementation of a C# class that performs an asynchronous download of a file (over HTTP) providing call-backs for both progress and to indicate when the download is complete.

Introduction

Recently I needed my application to be able to retrieve a graphic from a web-server. During the download the rest of the application should still operate with full functionality. Typically a placeholder graphic being used until the download had completed. As soon as the download is complete, the newly downloaded graphic would be used rather than the placeholder.

Because the interface can look a little weird until all the downloads are complete, the user really needs to be aware that this is something that will be rectified after the download is complete.

Framework Provided Solutions

Since .Net operates within a rich framework, there is a good chance that Microsoft have already provided a number of different classes to help:

The WebRequest and HttpWebResponse classes allows a really simple download function to be implemented in just a few lines of code. Indeed, the following code worked for a while:

public Image GetImage(string urlFile)
{
    WebRequest wreq = WebRequest.Create( urlFile );
    HttpWebResponse httpResponse = (HttpWebResponse) wreq.GetResponse();
    Stream stream = httpResponse.GetResponseStream();
    return Image.FromStream(stream);
}

The problem with the above code was that with a large download or a slow web-site, the GetImage function above both locks the main application thread of my program and provides no download progress to the user. Obviously, there were still some options:

  • Use a new thread to perform the download, thus leaving my main thread free to work;
  • Use the Asynchronous stream mechanisms;

Existing Implementations

I found a couple of VB.NET examples that implemented the Asynchronous download of the file, however they still had some problems:

  1. After starting the asynchronous download, they had to wait at a ManualResetEvent to await the download to complete;
  2. They did not display any download progress;
  3. The used the StringBuilder class to store the download.

The final point was my biggest problem, with the conversion from bytes to chars would render the download pointless, trimming out important information from the download making construction of the image impossible.

My Requirements

  1. Shall not block operation with application (including its functionality, not simply the user-interface);
  2. Shall be capable of providing some progress indication;
  3. Shall notify when the download is complete;
  4. Shall preserve all of the downloaded information;
  5. Shall cope with unknown file sizes (Note, all information is stored in memory, so there is a limit to file sizes);

The Solution

Shown below are the classes implemented to satisfy my requirements above.

The DownloadThread class simply wraps my download thread and provides a logical place to store the DownloadCompleteHandler. It is also responsible for instantiating the WebDownload class and calling its Download method.

The DownloadInfo class is a simple class storing the download information, this information can be passed around within the asynchronous calls, providing access to the overall download (not just the snip that the call-back is informed).

The WebDownload class wraps the asynchronous download functionality with two call-backs,

  • Download is the main function, it initiates the download and then waits for the download to complete. Depending on what type of buffers are used, this function may also construct a byte[] return type from the working buffer;
  • ResponseCallback is called by the .Net Framework when the initial response from the web-server has been received. At this point, it is possible to look at the HTTP headers and determine if the web-server has specified the size of the file. If so, a byte array (byte[]) is created of the correct size. This is flagged in the DownloadInfo class with useFastBuffers set to true. If the file size is not known, slow buffers are used (which is a System.Collection.ArrayList allowing the contents to grow during the download);
  • ReadCallback is called whenever the read-buffer (set to 1k) fills up, at this point, the master-buffer gains this new read-buffer and the progress call-back is called.

Usage

The included tester application simply uses the following to start a download.

if ( this.downloadUrlTextBox.Text != "" )
{
  this.outputGroupBox.Enabled = true;

  // Initialize all form information
  this.bytesDownloadedTextBox.Text = "";
  this.totalBytesTextBox.Text = "";
  this.progressBar.Minimum = 0;
  this.progressBar.Maximum = 0;
  this.progressBar.Value = 0;

  // Create the download thread (class) and populate with filename and callbacks
  DownloadThread dl = new DownloadThread();
  dl.DownloadUrl = this.downloadUrlTextBox.Text;
  dl.CompleteCallback += new DownloadCompleteHandler( DownloadCompleteCallback );
  dl.ProgressCallback += new DownloadProgressHandler( DownloadProgressCallback );

  // Start the download thread....
  System.Threading.Thread t = new System.Threading.Thread( 
    new System.Threading.ThreadStart(
      dl.Download ));
  t.Start();
}

The tester application also changes its appearance slightly when the progress call-back indicates that the total file size is unknown. It hides the progress bar and places "Total File Size Not Known" within the Total Bytes display. The Bytes Downloaded display still counts up with the progress so far.

Known Issues

An OutOfMemoryException is raised when very large files are downloaded (40Mb caused it in my case, although this corresponded with my system running out of virtual memory).

Conclusion

Currently, this class exists within quite a safe environment. It is hoped that by sharing the code here, not only will others benefit from my efforts but also, with wider testing, any bugs can be discovered sooner.

Disclaimer

These classes have been developed for a prototype application only, if you use them, it is your responsibility to test them against your requirements.

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

About the Author

Ray Hayes
Product Manager
United Kingdom United Kingdom
No Biography provided

Comments and Discussions

 
Questionhey Dear PinmemberSama'a201226-Oct-12 20:36 
GeneralNice Article PinmemberMember 88425112-Jan-08 22:10 
GeneralRe: Nice Article Pinmemberddarko10011-Sep-09 10:23 
GeneralThanks! PinmemberSeansms4-Jan-08 11:46 
General.net 2.0 compatibility - Access Violation Exception Pinmemberconnexion24-Jun-07 6:06 
QuestionResume? Pinmembertomsmaily1236-Sep-06 11:32 
AnswerRe: Resume? PinmemberRay Hayes6-Sep-06 12:23 
Most likely it can be done. I'm usually stuck behind a firewall at work which doesn't let me resume because of anti-virus scanning of downloads.
 
However, off the top of my head...
 
1) Check that the server supports resuming by looking in the HttpWebResponse for a property indicating that a range is available.
2) Look at the length of whatever you have "saved" and work out what range you want.
3) Ask for it in the request.
 
I'm sure someone should be able to help with the range/request options.   They're standard things for Web-Servers, but Microsoft hasn't documented these.
 
<div class='ForumSig'>Regards, Ray</div>
GeneralInvokeRequired not handled properly, might be causing the OutOfMemoryException. Pinmembercpark0311-Nov-05 4:55 
GeneralRetrieving a list of Directories from a URL PinmemberLeon v Wyk21-Oct-05 6:09 
GeneralRe: Retrieving a list of Directories from a URL PinmemberRay Hayes22-Oct-05 0:08 
GeneralExcellent Article PinmemberRyan Bost10-Oct-05 11:23 
GeneralProblems with proxy PinmemberAlesBoldrik8-Aug-05 2:40 
GeneralRe: Problems with proxy PinsussAnonymous8-Aug-05 6:55 
GeneralRe: Problems with proxy Pinmembern_dru15-Oct-07 22:03 
GeneralBeginInvoke PinmemberM.C.K.8-Jun-05 0:49 
GeneralRe: BeginInvoke PinmemberRay Hayes8-Jun-05 1:01 
QuestionHow to implement with Compact Framework? PinmemberTravisSmith23-Feb-05 22:27 
AnswerRe: How to implement with Compact Framework? PinmemberRay Hayes23-Feb-05 22:49 
QuestionFilename? PinmemberTyronX8-Jan-05 12:23 
AnswerRe: Filename? PinmemberRay Hayes9-Jan-05 6:26 
GeneralRe: Filename? PinmemberTyronX10-Jan-05 8:39 
AnswerRe: Filename? Pinmemberwefra29-Oct-05 20:00 
GeneralRe: Filename? PinmemberDaltonic2-Nov-05 1:01 
GeneralDownload file from FTP site PinmemberCasp14-Dec-04 4:18 
GeneralXcelent Article: Some Improvement Suggestions PinmemberShay Ben-Sasson3-Dec-04 23:02 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Mobile
Web04 | 2.8.140415.2 | Last Updated 20 Jul 2002
Article Copyright 2002 by Ray Hayes
Everything else Copyright © CodeProject, 1999-2014
Terms of Use
Layout: fixed | fluid