[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Very large rev files

From: Rick Yorgason <rick_at_ldagames.com>
Date: 2007-03-29 09:51:33 CEST

Roy Franz wrote:
> Rick - you should try using xdelta with the -0 option, as this
> prevents zlib compression of the output. Since your data sets sound
> very compressible, this could be part of what is making xdelta produce
> much smaller results.

Good call. I've done some more experiments, this time with 93 revisions
of my test file in a test repository using xdelta3
<http://www.xdelta.org/> and xdelta
<http://evanjones.ca/software/xdelta-win32.html>. There's no -0 test
for xdelta, because it seems the Windows port ignores the compression
flag and always uses the default. I also didn't want to test this on my
FreeBSD machine (which has a working implementation of xdelta), because
it's slow and all the way across the Internet.

Here's my results:

> Rev# Raw db/revs Xdelta3 -0 Xdelta3 Xdelta3 -9 Xdelta
> 0 115
> 1 55M 26M
> 2 55M 23M 501K 445K 378K 327K
> 3 55M 23M 129K 120K 100K 100K
> 4 55M 23M 89K 76K 56K 82K
> 5 55M 23M 23K 21K 16K 29K
> 6 55M 22M 47K 44K 28K 50K
> 7 55M 22M 13K 13K 11K 19K
> 8 55M 22M 11K 11K 8.8K 19K
> 9 55M 23M 20K 19K 8.7K 17K
> 10 55M 22M 9.1K 9.4K 8.0K 19K
> 11 55M 22M 14K 14K 13K 22K
> 12 55M 23M 44K 43K 41K 46K
> 13 55M 23M 16K 16K 14K 23K
> 14 55M 22M 38K 37K 33K 39K
> 15 55M 22M 18K 14K 11K 22K
> 16 55M 23M 43K 43K 39K 43K
> 17 55M 23M 21K 20K 18K 26K
> 18 55M 23M 89K 89K 83K 82K
> 19 55M 23M 16K 17K 8.5K 18K
> 20 55M 26K 862 765 721 823
> 21 55M 23M 14K 14K 11K 21K
> 22 55M 22M 24K 24K 20K 38K
> 23 55M 22M 22K 20K 16K 27K
> 24 55M 22M 16K 16K 13K 21K
> 25 55M 23M 15K 15K 13K 21K
> 26 55M 22M 37K 38K 22K 39K
> 27 55M 22M 12K 12K 8.3K 18K
> 28 55M 22M 13K 13K 9.0K 19K
> 29 55M 22M 18K 18K 17K 26K
> 30 55M 489K 12K 9.7K 8.4K 9.0K
> 31 55M 22M 18K 17K 14K 25K
> 32 55M 22M 27K 27K 18K 32K
> 33 55M 23M 22K 19K 17K 29K
> 34 55M 22M 19K 18K 16K 26K
> 35 55M 22M 19K 17K 12K 22K
> 36 55M 22M 12K 12K 9.1K 20K
> 37 55M 22M 18K 17K 15K 25K
> 38 55M 22M 18K 17K 14K 23K
> 39 55M 22M 29K 23K 18K 28K
> 40 55M 22M 14K 13K 11K 22K
> 41 55M 23M 26K 23K 15K 24K
> 42 55M 22M 16K 16K 9.8K 21K
> 43 55M 22M 15K 14K 11K 20K
> 44 55M 22M 24K 21K 17K 27K
> 45 55M 22M 30K 26K 21K 37K
> 46 55M 22M 49K 47K 25K 43K
> 47 55M 22M 27K 24K 19K 29K
> 48 55M 22M 34K 33K 28K 43K
> 49 55M 23M 19K 18K 14K 23K
> 50 55M 22M 14K 13K 11K 21K
> 51 55M 22M 13K 13K 8.9K 18K
> 52 55M 22M 16K 15K 12K 22K
> 53 55M 22M 18K 17K 15K 24K
> 54 55M 22M 20K 18K 14K 25K
> 55 55M 22M 21K 19K 13K 23K
> 56 56M 22M 24K 21K 18K 29K
> 57 56M 23M 28K 26K 21K 31K
> 58 56M 22M 25K 24K 16K 29K
> 59 56M 23M 53K 49K 44K 54K
> 60 56M 22M 35K 34K 30K 40K
> 61 56M 23M 30K 29K 26K 35K
> 62 56M 22M 19K 18K 14K 24K
> 63 56M 22M 16K 16K 13K 25K
> 64 56M 22M 17K 15K 12K 22K
> 65 56M 23M 14K 14K 11K 22K
> 66 56M 22M 14K 14K 8.9K 20K
> 67 56M 22M 17K 16K 10K 19K
> 68 56M 22M 17K 17K 14K 24K
> 69 56M 22M 15K 15K 12K 22K
> 70 56M 22M 13K 12K 9.3K 20K
> 71 56M 22M 25K 21K 11K 22K
> 72 56M 22M 20K 18K 13K 26K
> 73 56M 22M 15K 16K 11K 24K
> 74 56M 22M 28K 28K 20K 34K
> 75 56M 22M 31K 30K 23K 33K
> 76 56M 23M 81K 78K 72K 76K
> 77 56M 23M 36K 35K 32K 42K
> 78 56M 22M 42K 41K 30K 38K
> 79 56M 23M 27K 26K 19K 31K
> 80 56M 22M 19K 18K 12K 25K
> 81 56M 23M 16K 16K 12K 25K
> 82 56M 22M 21K 19K 15K 25K
> 83 56M 22M 51K 47K 17K 29K
> 84 56M 22M 44K 44K 23K 45K
> 85 56M 22M 43K 39K 14K 25K
> 86 56M 22M 17K 16K 13K 23K
> 87 56M 22M 14K 14K 11K 18K
> 88 56M 22M 16K 18K 9.7K 20K
> 89 56M 23M 99K 91K 56K 82K
> 90 56M 22M 44K 39K 29K 46K
> 91 56M 22M 134K 36K 26K 48K
> 92 56M 22M 23K 22K 16K 29K
> 93 56M 23M 214K 174K 131K 151K
> 94 56M 23M 579K 125K 92K 142K
>
> Total 5.1G 2.0G 4M 3M 2M 3M

That's a little difficult to swallow.

Maybe when I get some time I'll do another test with some long Wikipedia
page and an svn nightly.

-Rick-

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Received on Thu Mar 29 09:51:40 2007

This is an archived mail posted to the Subversion Users mailing list.