WordPress.org
Get WordPress

Make WordPress Core

Opened 9 years ago

Closed 9 years ago

Last modified 6 years ago

#28604 closed enhancement (fixed)

Change default robots.txt

Reported by: joostdevalk's profile joostdevalk Owned by: nacin's profile nacin
Milestone: 4.0 Priority: normal
Severity: normal Version: 4.0
Component: General Keywords: has-patch dev-feedback
Focuses: Cc:

Description

In ​this (2 years old) public service announcement Matt Cutts asks for websites to allow Google to spider CSS and JS.

Recently I've ran into pretty severe ranking problems for two sites that were robots.txt blocking their CSS, ​I've written about that here. As more and more JS and CSS gets included in and from /wp-includes/js/ and /wp-includes/css/, I think it's wise if we decide to unblock the wp-includes directory.

Attachments (1)

functions-robots.diff​ (429 bytes) - added by joostdevalk 9 years ago.
Patch

Download all attachments as: .zip

Change History (4)

@joostdevalk
9 years ago

Patch

#1 @nacin
9 years ago

  • Milestone changed from Awaiting Review to 4.0

#2 @nacin
9 years ago

  • Owner set to nacin
  • Resolution set to fixed
  • Status changed from new to closed

In 28794:

Stop denying wp-includes/* in our default robots.txt.

props joostdevalk.
fixes #28604.

This ticket was mentioned in ​Slack in #core-php by sergey. ​View the logs.
6 years ago

Note: See TracTickets for help on using tickets.