Click here to Skip to main content
13,096,858 members (73,074 online)
Rate this:
Please Sign up or sign in to vote.
See more:
HI friends
Im doing my final year project on Web page summarization.
I need an from u ppl... :( My project is all about summarizing the google page links and provide a short abstract of those links in the place of snippets below each link when we go for google search.
To start this ive to retrieve the contents of all those 10 links... For this i tried using web crawlers , html2txt s/w's but all ended in failure..
Please someone guide me to retrieve the contents in the web page links given by google search. Whe i used crawlers it retrieved all the contents.. like all the hyper links from that search result page.
Im talking about those 10 links alone which are returned by the google engine in return to our query... Please help me.. Still ive oly 3months to complete my project :(

[edit]Urgency deleted - OriginalGriff[/edit]
Posted 2-Jan-13 4:09am
Updated 2-Jan-13 4:11am
OriginalGriff 2-Jan-13 10:12am
Urgency deleted: It may be urgent to you, but it isn't to us. All that your stressing the urgency does is to make us think you have left it too late, and want us to do it for you. This annoys some people, and can slow a response.

BTW: Multiple exclamation marks are a sign of a diseased mind...
Ponscedric 2-Jan-13 10:14am

1 solution

Rate this: bad
Please Sign up or sign in to vote.

Solution 1

Read over this:[^]

It's a windows application and he is just getting the links on a page but it should get your headed in the right direction.
Ponscedric 2-Jan-13 10:35am
but sir i want to retrieve just the contents of a link. Say if we use "data mining" as our search query in google then it ll return top 10 links related to our query . I just want to retrieve the contents of those 10 links alone. not unnecesary links :(
Adam R Harris 2-Jan-13 12:02pm
You are going to have to use Regular Expressions or something similar to parse the links out of the response. Then you are going to have to get that page content the same way you got it from Google.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
Top Experts
Last 24hrsThis month

Advertise | Privacy |
Web01 | 2.8.170813.1 | Last Updated 2 Jan 2013
Copyright © CodeProject, 1999-2017
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100