WordPress.org
Get WordPress

Make WordPress Core

Opened 11 years ago

Closed 11 years ago

Last modified 7 years ago

#28604 closed enhancement (fixed)

Change default robots.txt

Reported by: joostdevalk's profile joostdevalk Owned by: nacin's profile nacin
Milestone: 4.0 Priority: normal
Severity: normal Version: 4.0
Component: General Keywords: has-patch dev-feedback
Focuses: Cc:

Description

In ​this (2 years old) public service announcement Matt Cutts asks for websites to allow Google to spider CSS and JS.

Recently I've ran into pretty severe ranking problems for two sites that were robots.txt blocking their CSS, ​I've written about that here. As more and more JS and CSS gets included in and from /wp-includes/js/ and /wp-includes/css/, I think it's wise if we decide to unblock the wp-includes directory.

Attachments (1)

functions-robots.diff​ (429 bytes) - added by joostdevalk 11 years ago.
Patch

Download all attachments as: .zip

Change History (4)

@joostdevalk
11 years ago

Patch

#1 @nacin
11 years ago

  • Milestone changed from Awaiting Review to 4.0

#2 @nacin
11 years ago

  • Owner set to nacin
  • Resolution set to fixed
  • Status changed from new to closed

In 28794:

Stop denying wp-includes/* in our default robots.txt.

props joostdevalk.
fixes #28604.

This ticket was mentioned in ​Slack in #core-php by sergey. ​View the logs.
7 years ago

Note: See TracTickets for help on using tickets.