Download webpage in csharp

Question

5.00/5 (2 votes)

See more:

Hi guys.

I 've built a system that downloads price board from a url and store into SQL Database. I 've test with many url. Some work fine and other doesn't works. Could any one tell me why?

using System.Net;
using System.IO;
using System.Windows.Forms;

string result = null;

string url = "http://priceboard.fpts.com.vn/user/stock/hcm3/?s=31&amp;rd=r15332110001";


WebResponse response = null;

StreamReader reader = null;
try

{

 HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);

 request.Method = "GET";

 response = request.GetResponse();

 reader = new StreamReader( response.GetResponseStream(), Encoding.UTF8 );

 result = reader.ReadToEnd();
 StreamWriter oSw = new StreamWriter("c:\\result.html");

 oSw.WriteLine(result);

 oSw.Close();


}

catch (Exception ex)

{

 // handle error

 MessageBox.Show( ex.Message );


}

finally

{

 if (reader != null)

 reader.Close();

 if (response != null)

 response.Close();

 MessageBox.Show("Download completed!.")

}

It works fine with URL in the code but didn't work with url http://quotes2.eurocapital.vn/

Help me fix it.

Thanks in advanced.

Posted 1-Nov-10 17:43pm

huynhdangthai

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

aayu · Answer 1 · 2010-11-01T20:28:00

XML

/// <summary>
/// Returns the content of a given web adress as string.
/// </summary>
/// <param name="Url">URL of the webpage</param>
/// <returns>Website content</returns>
public string DownloadWebPage(string Url)
{
    // Open a connection
    HttpWebRequest WebRequestObject = (HttpWebRequest)HttpWebRequest.Create(Url);
    // You can also specify additional header values like
    // the user agent or the referer:
    WebRequestObject.UserAgent  = ".NET Framework/2.0";
    WebRequestObject.Referer    = "http://www.example.com/";
    // Request response:
    WebResponse Response = WebRequestObject.GetResponse();
    // Open data stream:
    Stream WebStream = Response.GetResponseStream();
    // Create reader object:
    StreamReader Reader = new StreamReader(WebStream);
    // Read the entire stream content:
    string PageContent = Reader.ReadToEnd();
    // Cleanup
    Reader.Close();
    WebStream.Close();
    Response.Close();
    return PageContent;
}

string url = "http://google.com";
string strResult = "";
			
WebResponse objResponse;
WebRequest objRequest = System.Net.HttpWebRequest.Create(url);

objResponse = objRequest.GetResponse();

using (StreamReader sr = new StreamReader(objResponse.GetResponseStream()))
{
	strResult = sr.ReadToEnd();
	// Close and clean up the StreamReader
	sr.Close();
}

// Display results to a webpage
Response.Write(strResult);

Try both the code and even do some changes as per you want.

Vote OR Accept the answer if it is helpful:thumbsup::rose: