Click here to Skip to main content
12,887,625 members (36,998 online)
Rate this:
Please Sign up or sign in to vote.
See more: C#
How to implement Generic Crawler, for eg. i have 1000 website URLs
and and i want's get their website contactus page data i.e only contact information like Name address city phone etc .
so how do i implement this type of crawler in .net.
Posted 14-Jan-13 22:51pm

1 solution

Rate this: bad
Please Sign up or sign in to vote.

Solution 1

Hire a developer. Or do you seriously expect to get a complete source code?

Solution outline:
Open each URL.
Get contents.
Apply some sort of search function on the returned content, possibly using regular expressions.
Store result.

However, most web sites circumvent this by having contact information in images.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

    Print Answers RSS
Top Experts
Last 24hrsThis month

Advertise | Privacy | Mobile
Web02 | 2.8.170424.1 | Last Updated 25 Jan 2013
Copyright © CodeProject, 1999-2017
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100