WordPress.org

Make WordPress Core

Changes between Initial Version and Version 1 of Ticket #16416, comment 7


Ignore:
Timestamp:
01/31/2011 11:20:21 PM (10 years ago)
Author:
RanYanivHartstein
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #16416, comment 7

    initial v1  
    11Issues with robots.txt are not limited to "misbehaving" search engines - pages from sites blocked with robots.txt can show up in Google or any other search engine.
    22
    3 I like ask since it's technically accurate while still being human, but I don't think "normal" is necessary since search engines should not really be thought of as visitors anyway. Instead, how about:
     3I like "ask" since it's technically accurate while still being human, but I don't think "normal" is necessary since search engines should not really be thought of as visitors anyway. Instead, how about:
    44
    55  I would like to ask search engines not to index this site, but allow direct visitors