[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

svn get very very very slow or no response when accessing a dir with 10 thousand files in it

From: Gilbert Fine <gfan_at_corp.netease.com>
Date: 2004-02-25 14:05:49 CET

Hi All,

        We are running a repository (using HTTP/HTTPS protocol) on FreeBSD, subversion is 1.0.0. After commiting a dir with near 10 thousand files in it (total size is about 60M Bytes), other people cannot checkout this dir, or even 'svn list' on this dir. If using TSVN, you may get timeout message. If using svn command line, you may get the result, but you have to be very patient.

        This is top status of the server when 'svn up' timeout'ed on this dir:

last pid: 1169; load averages: 0.10, 0.22, 0.34 up 6+08:26:33 20:58:40
46 processes: 1 running, 45 sleeping
CPU states: 6.0% user, 0.0% nice, 1.8% system, 0.4% interrupt, 91.8% idle
Mem: 462M Active, 1083M Inact, 237M Wired, 12K Cache, 199M Buf, 227M Free
Swap: 4096M Total, 4096M Free

 1127 svn -2 0 163M 54792K ffsfsn 0 0:50 14.70% 14.70% httpd
 6943 root 2 0 17128K 3280K select 0 18:23 0.00% 0.00% nmbd
 1118 svn 2 0 438M 400M poll 0 7:52 0.00% 0.00% httpd

    Finally, I restart Apache.

    Things is a little different when use 'svn list' on it. httpd use much memory, almost no I/O, but I can get the result finally.

    To my surprise, using browser to list this dir is fast (as fast as visiting other dir).

    And I have modify some parametes in DB_CONFIG (and then run svnadmin recover):
set_lk_max_locks 200000
set_lk_max_lockers 200000
set_lk_max_objects 200000
    I don't know it helps or not.

Gilbert Fine
Received on Wed Feb 25 14:05:30 2004

This is an archived mail posted to the Subversion Dev mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.