Click here to Skip to main content
15,903,012 members
Please Sign up or sign in to vote.
1.00/5 (1 vote)
See more:
how to crawl websites link and show on our own websites
1:Content of websites link should be related to finance
Posted
Comments
By coding.
[no name] 12-Mar-15 14:17pm    
yes ,by coding
Sergey Alexandrovich Kryukov 12-Mar-15 17:00pm    
No, not "yes, by coding", but by coding. Can you see the difference? :-)
—SA

You're not going to get that kind of explanation in a couple of forum posts. There's simply too much information to go over.

Google for "C# web crawler" for articles and examples.
 
Share this answer
 
Very basically, it requires some techniques of Web scraping: http://en.wikipedia.org/wiki/Web_scraping[^].

Please see my past answers:
get specific data from web page[^],
Performing a some kind of Web Request and getting result[^].

—SA
 
Share this answer
 
Comments
AmitGajjar 12-Mar-15 17:06pm    
5+
Sergey Alexandrovich Kryukov 12-Mar-15 17:40pm    
Thank you, Amit.
—SA
[no name] 12-Mar-15 23:21pm    
Thank you,SA
Sergey Alexandrovich Kryukov 13-Mar-15 0:23am    
You are very welcome.
—SA
If you're going to code it yourself, you'll probably want to take a look at the HTML Agaility Pack http://htmlagilitypack.codeplex.com/[^] for parsing the HTML and using HttpWebRequest's or something similar to get the page content.
 
Share this answer
 

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)



CodeProject, 20 Bay Street, 11th Floor Toronto, Ontario, Canada M5J 2N8 +1 (416) 849-8900