Freeze Break Request: add robots.txt to public facing taskotron instances

[Tim Flink]

On Wed, 5 Aug 2015 11:53:49 -0600
Tim Flink <tflink at redhat.com> wrote:

<snip>

> I'd like to add a robots.txt to the public facing taskotron instances
> so that we can avoid this in the future. Rendered content of the
> robots.txt is at the end of this email.

<snip>

New robots.txt applied to taskotron production and staging.

Thanks,

Tim
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 473 bytes
Desc: OpenPGP digital signature
URL: <http://lists.fedoraproject.org/pipermail/infrastructure/attachments/20150805/96aff423/attachment.sig>