Click here to Skip to main content
12,348,850 members (49,677 online)
Rate this:
Please Sign up or sign in to vote.
See more: Robot
I have created my website in ASP.NET.

Crawel Error in google webmaster tool shows the error with response code 404 in following pages:

1) Samsung_S3653-Corby_Pictures/ContactUs.aspx
2) LG_KP199_Pictures/privacypolicy.aspx

Full link of above urls are below:


Actually these pages doesn't exists on server. There was some problem in my sitemap. I already fixed that in my sitemap. as these problem pages already have been indexed by google. so google webmaster still shows Crawel error 404.

I want to block these two links in robots.txt file.

You can notice these url are created by routing.

I am not sure how to block these urls.

Please help me to block these urls in Robots.txt file.
Posted 25-May-13 17:27pm

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

  Print Answers RSS
Top Experts
Last 24hrsThis month

Advertise | Privacy | Mobile
Web02 | 2.8.160621.1 | Last Updated 25 May 2013
Copyright © CodeProject, 1999-2016
All Rights Reserved. Terms of Service
Layout: fixed | fluid

CodeProject, 503-250 Ferrand Drive Toronto Ontario, M3C 3G8 Canada +1 416-849-8900 x 100