Click here to Skip to main content
11,715,425 members (80,334 online)
Rate this: bad
good
Please Sign up or sign in to vote.
See more: Robot
I have created my website www.mobilescorner.com in ASP.NET.

Crawel Error in google webmaster tool shows the error with response code 404 in following pages:

1) Samsung_S3653-Corby_Pictures/ContactUs.aspx
2) LG_KP199_Pictures/privacypolicy.aspx

Full link of above urls are below:

1) www.mobilescorner.com/Samsung_S3653-Corby_Pictures/ContactUs.aspx
2) www.mobilescorner.com/LG_KP199_Pictures/privacypolicy.aspx

Actually these pages doesn't exists on server. There was some problem in my sitemap. I already fixed that in my sitemap. as these problem pages already have been indexed by google. so google webmaster still shows Crawel error 404.

I want to block these two links in robots.txt file.

You can notice these url are created by asp.net routing.

I am not sure how to block these urls.

Please help me to block these urls in Robots.txt file.
Posted 25-May-13 17:27pm

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
0 Sergey Alexandrovich Kryukov 485
1 Richard MacCutchan 275
2 Maciej Los 259
3 ManasKumarM 155
4 Frankie-C 125
0 Sergey Alexandrovich Kryukov 785
1 CHill60 415
2 Richard MacCutchan 405
3 Maciej Los 389
4 OriginalGriff 320


Advertise | Privacy | Mobile
Web03 | 2.8.150901.1 | Last Updated 25 May 2013
Copyright © CodeProject, 1999-2015
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100