Click here to Skip to main content
Rate this: bad
Please Sign up or sign in to vote.
See more: C#
How to implement Generic Crawler, for eg. i have 1000 website URLs
and and i want's get their website contactus page data i.e only contact information like Name address city phone etc .
so how do i implement this type of crawler in .net.
Posted 14-Jan-13 22:51pm

1 solution

Rate this: bad
Please Sign up or sign in to vote.

Solution 1

Hire a developer. Or do you seriously expect to get a complete source code?
Solution outline:
Open each URL.
Get contents.
Apply some sort of search function on the returned content, possibly using regular expressions.
Store result.
However, most web sites circumvent this by having contact information in images.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
0 OriginalGriff 278
1 Maciej Los 205
2 Nguyen.H.H.Dang 190
3 arvind mepani 187
4 Peter Leow 180

Advertise | Privacy | Mobile
Web02 | 2.8.140709.1 | Last Updated 25 Jan 2013
Copyright © CodeProject, 1999-2014
All Rights Reserved. Terms of Service
Layout: fixed | fluid