change request - make robots.txt work on fho

Toshio Kuratomi a.badger at gmail.com
Tue May 10 21:13:21 UTC 2011


On Tue, May 10, 2011 at 03:45:15PM -0400, Ricky Elrod wrote:
> Hm... maybe not. Is that something we want to look into before hand? I'm not
> sure what kind of options exist for that, as I don't use svn that often (or at
> all).
> 
I'm +1 even without a separate, indexed-by-google web viewer for svn.

svn can be configured to be browsable by http with just svn itself, not sure
if there's a reason we aren't (apparently) doing that.

-Toshio

> On Tue, May 10, 2011 at 3:01 PM, Toshio Kuratomi <a.badger at gmail.com> wrote:
> 
>     On Tue, May 10, 2011 at 02:02:11PM -0400, Ricky Elrod wrote:
>     > Wanted to do this before freeze, but never had a chance -- let's get
>     robots.txt
>     > working on hosted1 and try to bring down cpu load and improve page load
>     times a
>     > bit.
>     >
>     > Thoughts/+1's please. robots.txt is already there and has been for a long
>     time,
>     > but nothing has told apache to use it, because apache requests go
>     straight to
>     > trac.
>     >
>     > robots.txt is set to block crawlers from accessing fh.o/*/browser/*
>     (which is
>     > the trac source code browser) -- as per https://fedorahosted.org/
>     > fedora-infrastructure/ticket/1848
>     >
>     +1
> 
>     The web interfaces at git.fedorahosted.org/git/, bzr.fp.o/bzr, and
>     hg.fp.o/hg take care of this I think.  The one question I have in regards
>     to
>     this is do we have an svn web viewer?
> 
>     -Toshio
>     >
>     >
>     > diff --git a/configs/web/fedorahosted.org.conf b/configs/web/
>     > fedorahosted.org.conf
>     > index d0f7139..8f1f2e1 100644
>     > --- a/configs/web/fedorahosted.org.conf
>     > +++ b/configs/web/fedorahosted.org.conf
>     > @@ -2,6 +2,9 @@
>     >      ServerName fedorahosted.org
>     >      ServerAlias www.fedorahosted.org
>     >
>     > +    # Make robots.txt be used.
>     > +    Alias /robots.txt /srv/web/fedorahosted.org/robots.txt
>     > +
>     >      Redirect 301 / https://fedorahosted.org/
>     >  </VirtualHost>
>     >
> 
>     > _______________________________________________
>     > infrastructure mailing list
>     > infrastructure at lists.fedoraproject.org
>     > https://admin.fedoraproject.org/mailman/listinfo/infrastructure
> 
> 
>     _______________________________________________
>     infrastructure mailing list
>     infrastructure at lists.fedoraproject.org
>     https://admin.fedoraproject.org/mailman/listinfo/infrastructure
> 
> 

> _______________________________________________
> infrastructure mailing list
> infrastructure at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/infrastructure

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: not available
Url : http://lists.fedoraproject.org/pipermail/infrastructure/attachments/20110510/7f96b482/attachment.bin 


More information about the infrastructure mailing list