[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Subversion and large directories

From: Balázs Szabó <dlux_at_dlux.hu>
Date: 2003-12-14 23:53:34 CET

Hi,

I have just started to use subversion for archiving my mails. Yes, it
sounds strange, but it costs much less space than always tar.gz my 500M
mail-archive.

My mailbox-collection is in Maildir format, and the largest directory
contains 22700 emails. The problem is that subversion is slowed down
when imports this large directory. (In the beginning it imported 10-15
mails/sec, now it takes 20 seconds to import one mail).

I have tweaked DB_CONFIG with the following values:

set_lk_max_locks 50000
set_lk_max_lockers 50000
set_lk_max_objects 50000

set_lg_bsize 2097152
set_lg_max 8388608

set_flags DB_TXN_NOSYNC
set_cachesize 0 234881024 3

I have 256M memory in my machine, so I cannot give more cache to this.

My vmstat showed that it reads a lot of data from the disk (5-10M/s)
while importing the directory.

Is it possible to speed up the import? I don't want to change my folder
structure if not necessary...

Regards,

Balázs Szabó (dLux)
dlux@dlux.hu
Received on Mon Dec 15 04:44:00 2003

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.