How to get all the websites in C#

Question

1.00/5 (2 votes)

See more:

Hey all,
I am making a program in which it gets all the websites in one search page and gets the url or those websites then it will show all of the websites in a text box. Not a web browser.
I mean like when Client Enters a search My program will write all the websites names. Using Google. Like imagine in google i enter 'Hello'. Then my tool finds all websites in the page and lists them in a text box

How can i do that

Posted 5-Nov-12 10:26am

Cyberwarfare

Updated 5-Nov-12 10:52am

v2

Add a Solution

Comments

Sergey Alexandrovich Kryukov 5-Nov-12 16:28pm

All Web sites? No, too many... How about almost all? :-)
--SA

Cyberwarfare 5-Nov-12 16:52pm

Okay sorry I improved my question now please hope you all understand

[no name] 5-Nov-12 16:55pm

Do you just want a page search or to search the entire web?

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Sergey Alexandrovich Kryukov · Answer 1 · 2012-11-05T10:56:00

Solution 1

This looks like something called Web scraping: http://en.wikipedia.org/wiki/Web_scraping[^].

Please see my past answers explaining what's involved:
How to get the data from another site[^],
get specific data from web page[^].

—SA

Posted 5-Nov-12 10:56am

Sergey Alexandrovich Kryukov

Leonardo Paneque · Answer 2 · 2012-11-05T11:53:00

You can use either Bing API or Google API to perform the search for a keyword and list your websites (results)

for bing.
http://www.bing.com/developers/s/APIBasics.html[^]

for google
https://developers.google.com/custom-search/v1/overview[^]

You use these APIs from anywhere, windows forms, wpf, silverlight or asp.net.

if you already have a page listing the content that you need to scrap, then use Sergey's approach (above)