Ticket #478 (closed defect: fixed)
Opened 8 years ago
Last modified 20 months ago
Disallow web robots indexing of old Wiki info
| Reported by: | daniel | Owned by: | daniel |
|---|---|---|---|
| Priority: | normal | Milestone: | 0.8 |
| Component: | wiki system | Version: | 0.7 |
| Severity: | minor | Keywords: | noindex |
| Cc: | |||
| Release Notes: | |||
| API Changes: | |||
Description
Trac should send html headers to instruct searchbots to not index old versions of pages or diffs.
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
Attachments
Change History
comment:1 Changed 8 years ago by anonymous
- Summary changed from Disallow web robots to old Wiki info to Disallow web robots indexing of old Wiki info
comment:2 Changed 8 years ago by daniel
comment:3 Changed 8 years ago by daniel
comment:4 Changed 8 years ago by daniel
- Owner changed from jonas to daniel
- Status changed from new to assigned
comment:5 Changed 8 years ago by daniel
- Resolution set to fixed
- Status changed from assigned to closed
Fixed in [717].
comment:6 Changed 7 years ago by sean.dawson@…
- Resolution fixed deleted
- Status changed from closed to reopened
Reopening; most recent version of source:trunk/trac/Wiki.py seems to have this backwards:
if version:
self.add_link('alternate',
'?version=%s&format=txt' % version, 'Plain Text',
'text/plain')
else:
self.add_link('alternate', '?format=txt', 'Plain Text',
'text/plain')
# Ask web spiders to not index old versions
req.hdf['html.norobots'] = 1
This block will set the html.norobots flag when version isn't specified (most recent page) — this isn't what you want I think.
Moving the html.robots into the first if block will fix this.
comment:7 Changed 7 years ago by anonymous
- Resolution set to fixed
- Status changed from reopened to closed
Good catch. This regression has been fixed in [1313].
(Please file issues like this as new tickets in the future, though.)
comment:8 Changed 7 years ago by cmlenz
That anonymous dude was me BTW :-P
comment:9 Changed 20 months ago by cboos
- Keywords noindex added



http://www.searchengineworld.com/cgi-bin/sim_spider.cgi