Click here to Skip to main content
12,997,531 members (58,674 online)
Rate this:
Please Sign up or sign in to vote.
See more:
Hi guys.

I 've built a system that downloads price board from a url and store into SQL Database. I 've test with many url. Some work fine and other doesn't works. Could any one tell me why?

using System.Net;
using System.IO;
using System.Windows.Forms;
string result = null;
string url = "";

WebResponse response = null;
StreamReader reader = null;
 HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
 request.Method = "GET";
 response = request.GetResponse();
 reader = new StreamReader( response.GetResponseStream(), Encoding.UTF8 );
 result = reader.ReadToEnd();
 StreamWriter oSw = new StreamWriter("c:\\result.html");

catch (Exception ex)
 // handle error
 MessageBox.Show( ex.Message );

 if (reader != null)
 if (response != null)
 MessageBox.Show("Download completed!.")

It works fine with URL in the code but didn't work with url

Help me fix it.

Thanks in advanced.
Posted 1-Nov-10 17:43pm

1 solution

Rate this: bad
Please Sign up or sign in to vote.

Solution 1

/// <summary>
/// Returns the content of a given web adress as string.
/// </summary>
/// <param name="Url">URL of the webpage</param>
/// <returns>Website content</returns>
public string DownloadWebPage(string Url)
    // Open a connection
    HttpWebRequest WebRequestObject = (HttpWebRequest)HttpWebRequest.Create(Url);
    // You can also specify additional header values like
    // the user agent or the referer:
    WebRequestObject.UserAgent  = ".NET Framework/2.0";
    WebRequestObject.Referer    = "";
    // Request response:
    WebResponse Response = WebRequestObject.GetResponse();
    // Open data stream:
    Stream WebStream = Response.GetResponseStream();
    // Create reader object:
    StreamReader Reader = new StreamReader(WebStream);
    // Read the entire stream content:
    string PageContent = Reader.ReadToEnd();
    // Cleanup
    return PageContent;

string url = "";
string strResult = "";
WebResponse objResponse;
WebRequest objRequest = System.Net.HttpWebRequest.Create(url);
objResponse = objRequest.GetResponse();
using (StreamReader sr = new StreamReader(objResponse.GetResponseStream()))
	strResult = sr.ReadToEnd();
	// Close and clean up the StreamReader
// Display results to a webpage

Try both the code and even do some changes as per you want.

Vote OR Accept the answer if it is helpful:thumbsup::rose:

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
Top Experts
Last 24hrsThis month

Advertise | Privacy | Mobile
Web02 | 2.8.170622.1 | Last Updated 2 Nov 2010
Copyright © CodeProject, 1999-2017
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100