stopping webcrawlers using robots.txt

Hi,

I have looked around but not found the answer to the question: how to
make /robots.txt visible in an apache virtual host config for a
subversion server. How would I tell Apache to allow requests to read
/robots.txt given the following configuration? (Or - how can I just
block robots going into the SVN repositories)?

<VirtualHost 1.2.3.4>
         ServerAdmin webmaster@xxxx.org

         ServerName svn.xxxx.org

         <Location />
                 DAV svn
                 SVNParentPath /usr/local/var/svn

                 # authorisation
                 AuthzSVNAccessFile /etc/subversion/access-control

                 # authentication
                 AuthType Basic
                 AuthName "development Subversion Repository"
                 AuthUserFile /etc/subversion/authentication

                 # anonymous access rules
                 Satisfy Any
                 Require valid-user
         </Location>
</VirtualHost>

thanks,

- thomas beale

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Sun Jul 9 20:05:18 2006