[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Huge number of rev files in in svn repository

From: Garrett Rooney <rooneg_at_electricjellyfish.net>
Date: 2006-06-12 23:05:09 CEST

On 6/12/06, Jon Smirl <jonsmirl@gmail.com> wrote:
> On 6/12/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote:
> > Nobody has implemented this because nobody has needed to yet. There
> > are numerous repositories as large or larger than the one you're
> > talking about that operate at perfectly reasonable speeds. On the
> > other hand, it's not like the standard use case is "extract every
> > single revision", so you may be hitting a bit of functionality that
> > isn't quite in the usual use case. If you have a need to speed this
> > up, perhaps you can work on a patch to add this functionality to
> > libsvn_fs_fs.
>
> It may be more deep than just the number of files in the repository.
> My Mozilla SVN has changes from 1998 to 2006. My export of the early
> years went fairly quickly. In 2002 it started getting slower, and I
> have been stuck in 2003 for over 24hrs. It is making forward progress
> but the progress is getting slower and slower.

Interesting. Some profiling data on that would be quite useful...

> I have converted the ext3 rev and revprop directories to use the
> dir_index format. Doing that did speed things up but overall it is
> still very slow. The process is completely CPU bound, disk activity is
> light.

What version of Subversion are you using? If you can try (from the
beginning, unfortunately, since the changes involved include a new
delta format in the filesystem, so need to start from the beginning)
the 1.4.x branch or the trunk it would be interesting to see if it
improves matters...

-garrett

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Mon Jun 12 23:07:01 2006

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.