[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Performance benchmarks

From: Stefan Sperling <stsp_at_elego.de>
Date: Sun, 27 Mar 2011 20:54:42 +0200

On Fri, Mar 25, 2011 at 01:33:25PM -0400, Mark Phippard wrote:
> Hi,
>
> I have been working on a framework for writing tests to record
> performance. I have something good enough to share:
>
> https://ctf.open.collab.net/sf/projects/csvn
>
> It is pretty easy to add new tests if you have ideas on more tests you
> think we should add. I think I have pretty good coverage of the major
> functions. The wiki on the site I linked to above has details on how
> I have constructed the current tests. I am going to put out a call to
> users for feedback and try to get more people to run the tests and
> record results.
>
> I am not claiming these are anything definitive or even that we will
> use them to help us make the release decision, but I think it is a
> start on coming up with some reproducible tests that people can run
> easily. If after people look at and run the tests they think they are
> useful or can be tweaked to be useful, then great. If not, then at
> least I got to write some code for a change :)
>
> The tests are written in Java because that is what I know and it gives
> me good cross platform coverage. However, the Java just drives the
> command line so all you need to do is have the svn command line in
> your PATH and that is what it uses for all the work.

I've run these tests on OpenBSD 4.9 (amd64) and got the following results:

=================== TEST RESULTS ==================
SVN Version: 1.6.17-dev

Tests: Basic Tests
                Action Time Millis
            ---------- --------- ---------
              Checkout: 0:21.232 21232
                Update: 1:07.533 67533
                Switch: 0:16.122 16122
              Proplist: 0:00.226 226
                Status: 0:00.174 174
                Commit: 0:05.883 5883
            svnversion: 0:00.104 104

Tests: Merge Tests
                Action Time Millis
            ---------- --------- ---------
             Merge-all: 0:27.993 27993
          Merge-revert: 0:12.054 12054
           Merge-synch: 0:15.082 15082
     Merge-reintegrate: 0:13.653 13653

Tests: Folder Tests
                Action Time Millis
            ---------- --------- ---------
             Folder-co: 10:02.645 602645
             Folder-st: 0:00.872 872
             Folder-ci: 1:16.709 76709
             Folder-up: 3:26.989 206989
            svnversion: 0:00.768 768

Tests: Binaries Tests
                Action Time Millis
            ---------- --------- ---------
                Bin-co: 4:09.777 249777
            Bin-up-r25: 2:49.036 169036
                Bin-sw: 3:46.945 226945
           Bin-cleanup: 0:01.069 1069
                Bin-rm: 0:03.232 3232
                Bin-st: 0:00.270 270
            Bin-commit: 0:07.356 7356
                Bin-mv: 0:05.662 5662
             Bin-st-mv: 0:00.275 275
            Bin-commit: 0:03.844 3844
            svnversion: 0:00.166 166

=================== END RESULTS ==================
  Total execution time: 34:44.375 2084375

Results in wiki format:

Basic Tests:
| 1.6.17-dev | r1085946 | 0:21.232 | 1:07.533 | 0:16.122 | 0:00.226 | 0:00.174

Merge Tests:
| 1.6.17-dev | r1085946 | 0:27.993 | 0:12.054 | 0:15.082 | 0:13.653

Folder Tests:
| 1.6.17-dev | r1085946 | 10:02.645 | 0:00.872 | 1:16.709 | 3:26.989 | 0:00.768

Binaries Tests:
| 1.6.17-dev | r1085946 | 4:09.777 | 2:49.036 | 3:46.945 | 0:01.069 | 0:03.232
.166

=================== TEST RESULTS ==================
SVN Version: 1.7.0-dev

Tests: Basic Tests
                Action Time Millis
            ---------- --------- ---------
              Checkout: 0:36.024 36024
                Update: 1:01.197 61197
                Switch: 0:02.004 2004
              Proplist: 0:00.198 198
                Status: 0:00.215 215
                Commit: 0:01.358 1358
            svnversion: 0:00.208 208

Tests: Merge Tests
                Action Time Millis
            ---------- --------- ---------
             Merge-all: 0:05.227 5227
          Merge-revert: 0:05.827 5827
           Merge-synch: 0:05.393 5393
     Merge-reintegrate: 0:11.169 11169

Tests: Folder Tests
                Action Time Millis
            ---------- --------- ---------
             Folder-co: 7:19.267 439267
             Folder-st: 0:01.209 1209
             Folder-ci: 0:10.676 10676
             Folder-up: 0:04.626 4626
            svnversion: 0:01.705 1705

Tests: Binaries Tests
                Action Time Millis
            ---------- --------- ---------
                Bin-co: 3:15.021 195021
            Bin-up-r25: 0:09.250 9250
                Bin-sw: 1:35.125 95125
           Bin-cleanup: 0:00.181 181
                Bin-rm: 0:42.754 42754
                Bin-st: 0:00.422 422
            Bin-commit: 0:04.432 4432
                Bin-mv: 0:12.726 12726
             Bin-st-mv: 0:00.415 415
            Bin-commit: 0:08.612 8612
            svnversion: 0:00.419 419

=================== END RESULTS ==================
  Total execution time: 18:38.683 1118683

Results in wiki format:

Basic Tests:
| 1.7.0-dev | r1085943 | 0:36.024 | 1:01.197 | 0:02.004 | 0:00.198 | 0:00.215 | 0:01.358 | 0:00.208

Merge Tests:
| 1.7.0-dev | r1085943 | 0:05.227 | 0:05.827 | 0:05.393 | 0:11.169

Folder Tests:
| 1.7.0-dev | r1085943 | 7:19.267 | 0:01.209 | 0:10.676 | 0:04.626 | 0:01.705

Binaries Tests:
| 1.7.0-dev | r1085943 | 3:15.021 | 0:09.250 | 1:35.125 | 0:00.181 | 0:42.754 | 0:00.422 | 0:04.432 | 0:12.726 | 0:00.415 | 0:08.612 | 0:00.419
Received on 2011-03-27 20:55:19 CEST

This is an archived mail posted to the Subversion Dev mailing list.