[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Huge number of rev files in in svn repository

From: Jon Smirl <jonsmirl_at_gmail.com>
Date: 2006-06-12 23:38:26 CEST

On 6/12/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote:
> On 6/12/06, Jon Smirl <jonsmirl@gmail.com> wrote:
> > On 6/12/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote:
> > > Nobody has implemented this because nobody has needed to yet. There
> > > are numerous repositories as large or larger than the one you're
> > > talking about that operate at perfectly reasonable speeds. On the
> > > other hand, it's not like the standard use case is "extract every
> > > single revision", so you may be hitting a bit of functionality that
> > > isn't quite in the usual use case. If you have a need to speed this
> > > up, perhaps you can work on a patch to add this functionality to
> > > libsvn_fs_fs.
> >
> > It may be more deep than just the number of files in the repository.
> > My Mozilla SVN has changes from 1998 to 2006. My export of the early
> > years went fairly quickly. In 2002 it started getting slower, and I
> > have been stuck in 2003 for over 24hrs. It is making forward progress
> > but the progress is getting slower and slower.
> Interesting. Some profiling data on that would be quite useful...

Linus wants profile data too but unfortunately I don't have profiling
turned on in the kernel I am running. I am planning on rebooting
tomorrow and I will switch kernels then.

> > I have converted the ext3 rev and revprop directories to use the
> > dir_index format. Doing that did speed things up but overall it is
> > still very slow. The process is completely CPU bound, disk activity is
> > light.
> What version of Subversion are you using? If you can try (from the
> beginning, unfortunately, since the changes involved include a new
> delta format in the filesystem, so need to start from the beginning)
> the 1.4.x branch or the trunk it would be interesting to see if it
> improves matters...


If I end up restarting the export I can try switching versions.

> -garrett

Jon Smirl
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Mon Jun 12 23:40:14 2006

This is an archived mail posted to the Subversion Users mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.