WordPress.org
Get WordPress

Make WordPress Core

Opened 12 years ago

Closed 12 years ago

Last modified 9 years ago

#28604 closed enhancement (fixed)

Change default robots.txt

Reported by: joostdevalk Owned by: nacin
Priority: normal Milestone: 4.0
Component: General Version: 4.0
Severity: normal Keywords: has-patch dev-feedback
Cc: Focuses:

Description

In ​this (2 years old) public service announcement Matt Cutts asks for websites to allow Google to spider CSS and JS.

Recently I've ran into pretty severe ranking problems for two sites that were robots.txt blocking their CSS, ​I've written about that here. As more and more JS and CSS gets included in and from /wp-includes/js/ and /wp-includes/css/, I think it's wise if we decide to unblock the wp-includes directory.

Attachments (1)

functions-robots.diff​ (429 bytes ) - added by joostdevalk 12 years ago.
Patch

Download all attachments as: .zip

Change History (4)

@joostdevalk
12 years ago

Patch

#1 @nacin
12 years ago

  • Milestone Awaiting Review → 4.0

#2 @nacin
12 years ago

  • Owner set to nacin
  • Resolution → fixed
  • Status new → closed

In 28794:

Stop denying wp-includes/* in our default robots.txt.

props joostdevalk.
fixes #28604.

This ticket was mentioned in ​Slack in #core-php by sergey. ​View the logs.
9 years ago

Note: See TracTickets for help on using tickets.