[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Checkout really slow in Windows with lots of files in one directory

From: Neil Bird <neil_at_jibbyjobby.co.uk>
Date: Wed, 02 Feb 2011 15:04:22 +0000

Around about 01/02/11 18:00, Mark Phippard typed ...
> I created a folder with 5001 files in it ... maybe that is not enough?

   I think the issue is to do with properties, so you'd have to make sure
all those files have props. (we use autoprops for

   IIRC, upon checkout the file is copied to .svn/tmp/text-base using a
version of the file name, but the associated prop-base file which the
metadata are put into is called tempfileXXX.tmp, with an ever-increasing
XXX, the calculation of which (via file probing) gives the logarithmic slow

   I don't know why it does that (or if I'm mis-interpreting) as the final
prop-base files are named after the source file and not a temp file name.

   Certainly, I've got 1.6.15 on both Linux and Windows and they both do
this on an NTFS drive (it was something like 85 minutes to check out our
~5200 files [may be 6200, can't remember]). Linux did it to ext3 in a
little over a minute.

   I have since compiled up the latest 1.6.x branch, and patched
svn_io_open_unique_file3() to not call svn_io_open_uniquely_named() with
'tempfile.tmp', & instead I cut'n'paste svn_io_open_uniquely_named(),
replacing the 1-99999 loop with 1-MAX_RAND and used the output of rand() in
the filename to try.

   This gave me a few seconds improvement in Linux, and a drastically
improved 5 minutes in Windows (possibly only now slower as it was writing to
a network mapped drive).

   I couldn't use the version from trunk/1.7 as it differs too much. I will
try to submit the patch for someone's perusal at some point, but I couldn't
properly test is as for some reason my build of svn out of 1.6.x svn (even
before modifying it) fails 'make check': all the tests pass, but I get a
load of XFAIL lines I don't understand.

   AFAICT, the XFAILs I get after my patch are the same as before, but it's
not the warm PASS feeling I was hoping for.

[neil_at_fnx ~]# rm -f .signature
[neil_at_fnx ~]# ls -l .signature
ls: .signature: No such file or directory
[neil_at_fnx ~]# exit
Received on 2011-02-02 16:05:08 CET

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.