Make WordPress Core

Opened 7 years ago

Closed 7 years ago

#6891 closed defect (bug) (fixed)

Do not add trailing slash to the robots.txt URL

Reported by: thenlich Owned by:
Milestone: 2.6 Priority: normal
Severity: normal Version: 2.5.1
Component: General Keywords: has-patch
Focuses: Cc:


The /robots.txt is redirected to /robots.txt/ if configured. This is in violation of the robot exclusion standard, which specifies

This file must be accessible via HTTP on the local URL "/robots.txt".

It is also not network nice because it generates extra traffic for the additional request after redirection.

Attachments (1)

6891.diff (682 bytes) - added by DD32 7 years ago.

Download all attachments as: .zip

Change History (3)

comment:1 @DD327 years ago

  • Keywords has-patch added
  • Milestone set to 2.6

I spotted this the other day, Didnt get around to submitting a trac ticket though, Thanks for bringing it up and reminding me :)

@DD327 years ago

comment:2 @ryan7 years ago

  • Resolution set to fixed
  • Status changed from new to closed

(In [7871]) Don't redirect robots. Props thenlich and DD32. fixes #6891

Note: See TracTickets for help on using tickets.