Design a news website with a creeper

Question

1.00/5 (1 vote)

See more:

Hello
I want to create a news website with creeper,so creeper searches some sites and returns new news and i show them in my website.but i dont want to use Rss.
so,how i can do it?what technique i use?how a creeper work?how i can create a creeper in asp.net.
too,the server shouldnt busy all times,for example per minute once creeper searches and returns result.
please get me a solution.
thanks

Posted 1-Jan-14 5:32am

NewWebDesigner

Updated 1-Jan-14 6:38am

JoCodes

v4

Add a Solution

Comments

OriginalGriff 1-Jan-14 11:40am

And?
What is the problem?
What have you tried? Where are you stuck?
Remember that we can't see your screen, access your HDD, or read your mind.
Use the "Improve question" widget to edit your question and provide better information.

NewWebDesigner 1-Jan-14 12:02pm

i stick from begin,how it work,how i do it?i dont know any thing about it.

JoCodes 1-Jan-14 12:36pm

This is a quick answer section and you have a series of questions. Also, "get me a solution" is not the way it works. try something first, then if stuck ask something specific.And the hint is to use "WebPage scraping" if dont want to use RSS feed. Many good tutorials are available on it.If still have doubt ,ask.

Sergey Alexandrovich Kryukov 1-Jan-14 13:58pm

Agree. I answered in sufficient detail, please see Solution 2.
—SA

JoCodes 2-Jan-14 1:10am

Thanks SA

NewWebDesigner 1-Jan-14 13:13pm

thank you.i begin search about "WebPage scraping tutorials".

JoCodes 2-Jan-14 1:11am

you are welcome. All the best.

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Sergey Alexandrovich Kryukov · Accepted Answer · 2014-01-01T07:57:00

You requirement of not using RSS is not just your choice, because the site to be "searched" may not provide RSS feed :-).

So, all you need is to use the techniques of Web scraping: http://en.wikipedia.org/wiki/Web_scraping[^].

Please see my past answers for further detail:
How to get the data from another site[^],
get specific data from web page[^].

Good luck. Happy New Year!

—SA