Control web browsing by C#

Question

0.00/5 (No votes)

See more:

There is a base with several information partly(each part appears after clicking a button). I want a program which loads the html code, takes the needed information,clicks the Next button and moves to the next part while all information is loaded.

C#

HttpWebRequest req; 
HttpWebResponse resp; 
StreamReader sr; 
string content; 
req = (HttpWebRequest)WebRequest.Create("testkrok.org.ua/"); 
resp = (HttpWebResponse)req.GetResponse(); 
sr = new StreamReader(resp.GetResponseStream(), Encoding.GetEncoding("windows-1251"));     
content = sr.ReadToEnd(); 
sr.Close();

This is how I gain HTML code, but I do not know how to ckick the button(the button in HTML code does not have name tag) and how get the code of next page. Thanks in advance

Posted 25-May-13 2:24am

Soroush Saadatfar

Updated 25-May-13 2:47am

Prasad Khandekar

v2

Add a Solution

Comments

Prasad Khandekar 25-May-13 8:56am

Hello,

The button click is actually a POST request, so what you will have to do is to send another web request to the URL to which the form gets submitted upon clicking the button. Simple way to get these url's is to open the site in web browser and manually record these url's. If you want to do this all via code then it's a long route. Besides parsing the HTML dom and figuring out which form the button belongs and the action attribute of the form will tell you the form submission url. This will work provided the button in question is not a submit button, else you may require to parse the javascript or find out the button click handler and then parse that javascript function to figure out the actual url. There can be multiple possibilities and things can really get complicated.

In short access the website in question via a web browser and manually record these url's and parameters used during each GET/POST. You can use chrome developer tools or HttpFox or Fiddler for this purpose. Another way is to use a web testing tool capable of recording the browser interactions. And then use this collected information in your program.

Regards,

[no name] 25-May-13 9:18am

Sounds like a solution to me...

Sergey Alexandrovich Kryukov 25-May-13 20:29pm

Agree. Actually, it all depends on what a button does. But, if it ultimately loads something like "next page", the problem is to determine what to do, because it can be a result of some more or less complicated JavaScript, instead of simple and immediate HTTP request...
—SA

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

sivakumarganga · Answer 1 · 2013-05-25T22:12:00

Hello Soroush Saadatfar,

If this is totally code back, it is much difficult to achieve, if your developing in windows form application,we can achieve by using webbrowser congtrol, by injecting JavaScript to click the next button, and we can collect the data on DocumentComplete Event,

Hope this will works

Thanks