Opened 10 years ago
Closed 10 years ago
#28556 closed defect (bug) (invalid)
robots.txt is not auto generated.
Reported by: | nicola.peluchetti | Owned by: | |
---|---|---|---|
Milestone: | Priority: | normal | |
Severity: | normal | Version: | 3.9.1 |
Component: | Query | Keywords: | close |
Focuses: | Cc: |
Description
If i have no robots.txt in my wordpress install and visit the robots.txt file in the browser, nothing is generated and a 404 is returned. No plugin installed, no permalinks enabled.
I've looked at the code and there doesn't seem to be any check for crawler user agent and i've got an old site in wordpress 3.5.1 which actually works.
I was trying to test a function that adds my rules to robots.txt.
To reproduce, simply try to visit the robots.txt file in your browser.
If i force it in query.php by returning true from is_robots, also a notice appears.
Attachments (3)
Change History (7)
#1
@
10 years ago
Sorry i meant "Pretty permalinks" enabled, don't know how to change the body of the ticket-
#2
@
10 years ago
- Keywords close added
WordPress only responds to a robots.txt
request when installed at the root of a domain:
tags/3.9.1/src/wp-includes/rewrite.php#L1551.
#3
@
10 years ago
See also Placement of the robots.txt file by Google.
404