Click here to Skip to main content
Rate this: bad
good
Please Sign up or sign in to vote.
See more: C#2.0
Hi guys.

I 've built a system that downloads price board from a url and store into SQL Database. I 've test with many url. Some work fine and other doesn't works. Could any one tell me why?
 
using System.Net;
using System.IO;
using System.Windows.Forms;
 
string result = null;
 
string url = "<a href="http://priceboard.fpts.com.vn/user/stock/hcm3/?s=31&amp;rd=r15332110001">http://priceboard.fpts.com.vn/user/stock/hcm3/?s=31&amp;rd=r15332110001</a>";

WebResponse response = null;
 
StreamReader reader = null;
try
 
{
 
 HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
 
 request.Method = "GET";
 
 response = request.GetResponse();
 
 reader = new StreamReader( response.GetResponseStream(), Encoding.UTF8 );
 
 result = reader.ReadToEnd();
 StreamWriter oSw = new StreamWriter("c:\result.html");
 
 oSw.WriteLine(result);
 
 oSw.Close();
 
}
 
catch (Exception ex)
 
{
 
 // handle error

 MessageBox.Show( ex.Message );
 
}
 
finally
 
{
 
 if (reader != null)
 
 reader.Close();
 
 if (response != null)
 
 response.Close();
 
 MessageBox.Show("Download completed!.")
 
}

It works fine with URL in the code but didn't work with url http://quotes2.eurocapital.vn/

Help me fix it.

Thanks in advanced.
Posted 1-Nov-10 18:43pm

1 solution

Rate this: bad
good
Please Sign up or sign in to vote.

Solution 1

/// <summary>
/// Returns the content of a given web adress as string.
/// </summary>
/// <param name="Url">URL of the webpage</param>
/// <returns>Website content</returns>
public string DownloadWebPage(string Url)
{
    // Open a connection
    HttpWebRequest WebRequestObject = (HttpWebRequest)HttpWebRequest.Create(Url);
    // You can also specify additional header values like
    // the user agent or the referer:
    WebRequestObject.UserAgent  = ".NET Framework/2.0";
    WebRequestObject.Referer    = "<a href="http://www.example.com/&quot">http://www.example.com/&quot</a>;;
    // Request response:
    WebResponse Response = WebRequestObject.GetResponse();
    // Open data stream:
    Stream WebStream = Response.GetResponseStream();
    // Create reader object:
    StreamReader Reader = new StreamReader(WebStream);
    // Read the entire stream content:
    string PageContent = Reader.ReadToEnd();
    // Cleanup
    Reader.Close();
    WebStream.Close();
    Response.Close();
    return PageContent;
}
 
string url = "<a href="http://google.com">http://google.com</a>";
string strResult = "";
 
WebResponse objResponse;
WebRequest objRequest = System.Net.HttpWebRequest.Create(url);
 
objResponse = objRequest.GetResponse();
 
using (StreamReader sr = new StreamReader(objResponse.GetResponseStream()))
{
    strResult = sr.ReadToEnd();
    // Close and clean up the StreamReader
    sr.Close();
}
 
// Display results to a webpage
Response.Write(strResult);

Try both the code and even do some changes as per you want.

Vote OR Accept the answer if it is helpfulThumbs Up | :thumbsup: Rose | [Rose]
  Permalink  

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
0 OriginalGriff 490
1 Sergey Alexandrovich Kryukov 405
2 Maciej Los 285
3 ProgramFOX 265
4 Peter Leow 210
0 OriginalGriff 490
1 Sergey Alexandrovich Kryukov 395
2 Maciej Los 285
3 ProgramFOX 265
4 CHill60 200


Advertise | Privacy | Mobile
Web04 | 2.8.150331.1 | Last Updated 2 Nov 2010
Copyright © CodeProject, 1999-2015
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100