How to retrieve links from a web page ?

Question

0.00/5 (No votes)

See more:

Hello

I was looking for some help regarding the problem that

Suppose there is one website....www.xyz.com
and there are 40 links on the website's home page.

Now i want that using C# and asp.net i do have an String array suppose LinkArray[n] and TabArray[n] {string array} and i want that there should be a program which
can list all the links in the array as follows.

links :

HTML

<a href="xyz.com/home.html">Home</a> <a href="xyz.com/Contact.html"> </a>

etc

Now i want that in two arrays it should be stored as

TabArray[2] (contains tabs in the array values)
Home
Contact

LinkArray[2] (contains links in the array values)
xyz.com/home.html
xyz.com/contact.html

Likewise i want that i can get listed all the links details in of any web page.

Please suggest me some code/ guide tutorials

Thanks

Posted 8-Oct-11 6:02am

LockedOut

Add a Solution

3 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

André Kraak · Answer 1 · 2011-10-08T06:10:00

Solution 1

Have a look at this article Screen Scraping with C# for ASP.NET[^].

Posted 8-Oct-11 6:10am

André Kraak

Comments

Rubaba 3-Dec-11 11:50am

5* for link

Monjurul Habib · Answer 2 · 2011-10-08T07:35:00

Solution 2

IF you want to scrape all HTML links and HREFs from specific web pages, for maintenance or validation of your site. This is called screen scraping. And You will find approx About 122,000 results (0.09 seconds)
google results by using screen scraping C# keywords. So better you google and improve your problem solving power.

Ref. C# Scraping HTML Links

For further information please feel free to leave a comment.

Posted 8-Oct-11 7:35am

Monjurul Habib

Updated 8-Oct-11 7:36am

v2

Comments

Rubaba 3-Dec-11 11:50am

nice answer 5*

Monjurul Habib 3-Dec-11 13:01pm

thank you Rubaba.

**theanil** · Answer 3 · 2011-10-08T09:25:00

Solution 3

http://stackoverflow.com/questions/5971662/how-to-find-all-links-in-web-page-using-coded-ui-test[^]

http://www.dotnetperls.com/scraping-html[^]

Posted 8-Oct-11 9:25am

theanil