Click here to Skip to main content
11,430,274 members (71,898 online)
Rate this: bad
good
Please Sign up or sign in to vote.
See more: Robot
I have created my website www.mobilescorner.com in ASP.NET.

Crawel Error in google webmaster tool shows the error with response code 404 in following pages:

1) Samsung_S3653-Corby_Pictures/ContactUs.aspx
2) LG_KP199_Pictures/privacypolicy.aspx

Full link of above urls are below:

1) www.mobilescorner.com/Samsung_S3653-Corby_Pictures/ContactUs.aspx
2) www.mobilescorner.com/LG_KP199_Pictures/privacypolicy.aspx

Actually these pages doesn't exists on server. There was some problem in my sitemap. I already fixed that in my sitemap. as these problem pages already have been indexed by google. so google webmaster still shows Crawel error 404.

I want to block these two links in robots.txt file.

You can notice these url are created by asp.net routing.

I am not sure how to block these urls.

Please help me to block these urls in Robots.txt file.
Posted 25-May-13 18:27pm

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)



Advertise | Privacy | Mobile
Web04 | 2.8.150428.2 | Last Updated 25 May 2013
Copyright © CodeProject, 1999-2015
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100