Changes between Version 1 and Version 2 of Ticket #43590, comment 9
- Timestamp:
- 08/21/2019 08:31:56 AM (6 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Ticket #43590, comment 9
v1 v2 1 Resurrecting this, as there's some nuance here.1 There's some nuance here. 2 2 3 3 1) As pointed out above, the Reading setting infers that it's intended to prevent search engines from ''indexing'' the content, rather than from ''crawling'' it. However, **the presence of the robots disallow rule prevents search engines from ever discovering the `noindex` directive**, and thus they may index 'fragments' (where the page is indexed without content).