Re: Minimizing repository growth when large files change....

Peter Valdemar Mørch swp5jhu02-at-sneakemail.com |Lists| wrote:
> Hi there,
>
> I'm trying to figure out how to store large ASCII (7-bit?) files in
> subversion in the most space-efficient manner.
...
>
> .gzs raw files
> First commit: 11.25 125.81
> Second commit: 46.21 411.35
> Rep Growth: 34.96 285.54
> Rep Growth Ratio: 308% 227%
>
> Repository size vs.
> Sum of file sizes
> after 2nd commit: 263% 286%
>

OK, well, I discovered it myself... (Why did it have to happen *after* i
  hit "Send"? :-D )

First off, I was using --fs-type bdb. And so removing the logs with
svnadmin list-unused-dblogs $rep | xargs rm
shaved off a lot of the space.

Second, now 1.1.X is available on Debian, so I tried the fsfs. And
*that* helped *a lot*!

The fsfs repository uses 11% of the space the bdb repository does - for
the exact same files! Hurray!

                    bdb fsfs
                    raw files raw files
First commit: 124.56 15.69
Second commit: 270.44 29.49
Rep Growth: 145.88 13.79
Rep Growth Ratio: 117% 88%

Repository size vs.
Sum of file sizes
after 2nd commit: 188% 20.4%

Peter

-- 
Peter Valdemar Mørch
http://www.morch.com
--
Script to reproduce:
#!/bin/bash
file1=f1
file2=f2
# file1=F1.gz
# file2=F2.gz
rm -rf rep dir/
# svnadmin create --fs-type fsfs rep
svnadmin create --fs-type bdb rep
export r=file://`pwd`/rep
svn mkdir -m "" $r/dir
svn co $r/dir
cp $file1 dir/file
svn add dir/file
svn ci -m "" dir
svnadmin list-unused-dblogs rep/ | xargs rm -f
echo
echo "Repos size 1"
calc.pl `du -s --block-size=1 rep | sed s/rep//` / 1024 / 1024
svn ci -m "" dir
cp $file2 dir/file
svn ci -m "" dir
svnadmin list-unused-dblogs rep/ | xargs rm -f
echo
echo "Repos size 2"
calc.pl `du -s --block-size=1 rep | sed s/rep//` / 1024 / 1024
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org