Changes between Version 1 and Version 2 of Ticket #40931, comment 7
- Timestamp:
- 09/13/2017 10:42:58 PM (7 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Ticket #40931, comment 7
v1 v2 1 I saw no pattern and have seen this error on multiple sites. It seems to be something that is triggered by bots that are spidering sites -- that is, when I have been able to trace the error in site logs, it often is triggered by a bot such as baidu. It did seem to help to add this line to the robots.txt for the site:1 I saw no pattern and have seen this error on multiple sites. It seems to be something that was triggered by bots or spiders -- that is, when I have been able to trace the error in site logs, it often was triggered by a bot such as baidu. It did seem to help to add this line to the robots.txt for the site: 2 2 3 3 User-agent: *