hgbook

diff web/robots.txt @ 588:188efaefe001

How to make all-ids.dat.
author Bryan O'Sullivan <bos@serpentine.com>
date Thu Mar 19 22:45:02 2009 -0700 (2009-03-19)
parents
children
line diff
     1.1 --- /dev/null	Thu Jan 01 00:00:00 1970 +0000
     1.2 +++ b/web/robots.txt	Thu Mar 19 22:45:02 2009 -0700
     1.3 @@ -0,0 +1,2 @@
     1.4 +User-agent: *
     1.5 +Disallow: /feeds/