RE: SVN checkout slow on windows compare to linux
From: <webpost_at_tigris.org>
Date: Thu, 23 Sep 2010 12:35:32 -0700 (PDT)
Totally agreed. Our repo has 31k files, a total of 120 MB. Linux checkout takes 2 minutes, Windows checkout takes 37 minutes (on only a little slower machine).
While checking out on Windows (Windows 7 x64, svn 1.6.12, TortoiseSVN 1.6.10, NTFS), TortoiseProc.exe eats 50% CPU (that is, one of the two cores). When a large file is being downloaded, the load drops. It clearly showed me that there is a per-file problem (instead of throughput, bandwidth limit, some kind of conversion [we made even test to check if the CR -> CR/LF conversion takes too much time], etc.)
Now I've fired up ProcMon from SysInternals. Here are some bottlenecks I've found:
1. Anytime "entries" is read, I see the following sequence: Open, Read 80 bytes, Close, Open, Read 80 bytes, Close, Open, Read whole file, Close. What is the reason behind this?
2. I've also found that the same "entries" file is being read several times (in the above way) consecutively, without any writes to that file, without any other operations between the two queries. So O, R80, C, O, R80, C, O, Rall, C, O, R80, C, O, R80, C, O, Rall, C, etc.
3. In some directories I see a loop. Svn tries to create a file "tempfile.tmp" and gets NAME COLLISION result. "tempfile.2.tmp" is tried then with the same result. And so on. Sometimes going up to even "tempfile.340.tmp". Seems some DeleteFile is missing. But why not use the GetTempFileName function anyway?
4. When a large file is being checked out, I see the following sequence:
5. It seems that the "entries" in the whole directory tree is checked for each repository file. Say file "root/dirA/dirB/fileC" is processed, and both dirA and dirB is already created. svn checks "root/entries", "root/dirA/entries", "root/dirA/dirB/entries", deals with the file, the checks (reads!) "root/dirA/dirB/entries" again, then "root/dirA/entries" and "root/entries".
All in all: Most of the lost time is spent with the "entries" files.
I'm willing to check any tests or test versions sent to me.
------------------------------------------------------
To unsubscribe from this discussion, e-mail: [users-unsubscribe_at_tortoisesvn.tigris.org].
|
This is an archived mail posted to the TortoiseSVN Users mailing list.
This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.