Click here to Skip to main content
Rate this: bad
good
Please Sign up or sign in to vote.
See more: C#
How to implement Generic Crawler, for eg. i have 1000 website URLs
and and i want's get their website contactus page data i.e only contact information like Name address city phone etc .
so how do i implement this type of crawler in .net.
Posted 14-Jan-13 22:51pm

1 solution

Rate this: bad
good
Please Sign up or sign in to vote.

Solution 1

Hire a developer. Or do you seriously expect to get a complete source code?
 
Solution outline:
Open each URL.
Get contents.
Apply some sort of search function on the returned content, possibly using regular expressions.
Store result.
Done.
 
However, most web sites circumvent this by having contact information in images.
  Permalink  

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
0 Sergey Alexandrovich Kryukov 265
1 _Amy 235
2 Peter Leow 205
3 Andreas Gieriet 180
4 Dave Kreskowiak 130
0 OriginalGriff 7,540
1 Sergey Alexandrovich Kryukov 6,412
2 Maciej Los 3,849
3 Peter Leow 3,653
4 CHill60 2,712


Advertise | Privacy | Mobile
Web03 | 2.8.140721.1 | Last Updated 25 Jan 2013
Copyright © CodeProject, 1999-2014
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100