Click here to Skip to main content
Click here to Skip to main content
Add your own
alternative version

Why a robots.txt file is no longer sufficient

Over the past year Google decided to partially ignore the robots.txt file in an attempt to increase the effectiveness of its results.

Revisions


  

Compare Revision Minor Date Status Editor
publicly available No 16-Jan-13 12:35 Available Smitha Vijayan
Updates in content. 11 changes had been made.
1 No 15-Jan-13 15:04 Draft Zac Gery

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

About the Author

Zac Gery

United States United States
Software Developer, Mentor, Architect and UX/UI craftsman. Also, a psychology nut that loves curling.
Follow on   Twitter   Google+

| Advertise | Privacy | Mobile
Web01 | 2.8.140709.1 | Last Updated 16 Jan 2013
Article Copyright 2013 by Zac Gery
Everything else Copyright © CodeProject, 1999-2014
Terms of Service
Layout: fixed | fluid