Disallow Trac project contents indexing by robots

[Michel Jouvin <jouvin@…>]

Hi,

I've been trying to build a server configuration where indexing of Trac project contents by robots would be disabled by default, with an exception for some projects (all projects being served by the same Trac instance).

It turns out to be difficult to do using the traditional ​robots.txt approach, as this file can contain only disallow clause. This means you have to update the file everytime you add a new project.

Another approach would be to add a ​meta tag to each page generated by Trac. This would allow to implement easily the use case described here… but requires Trac to do it!

My suggestion would be to add an option in trac.ini allowing to disable indexing by robots and resulting in the meta tag being added by Trac to each page it generates. Then it would be easy with a config file shared by every project to implement a default and override it in the context of some specific projects.

Michel

[Remy Blank]

Can't you do that with a site.html template?

[Michel Jouvin <jouvin@…>]

I must admit that I forgot about this possibility… Probably a little bit more difficult to configure than a real option but should be enough. I'll check and if it works, it may be worth documenting…

Michel

[Peter Suter]

Closed as worksforme assuming the suggestion of comment:2 worked.