Re: [svnbench] Revision: 1357620 compiled Jul 5 2012, 14:10:32

From: Neels J Hofmeyr <neels_at_elego.de>
Date: Thu, 05 Jul 2012 17:58:23 +0200

On 2012-07-05 16:41, neels_at_apache.org wrote:
> 1.7.0_at_1181106 vs. trunk_at_1357617
> Started at Thu Jul 5 14:14:07 UTC 2012
>
> *Disclaimer* - This tests only file://-URL access on a GNU/Linux VM.
> This is intended to measure changes in performance of the local working
> copy layer, *only*. These results are *not* generally true for everyone.
>
> Averaged-total results across all runs:
> ---------------------------------------
>
> Compare 1.7.0 to trunk_at_1357617
> N avg operation
> 3/9 1.37|+46.305 TOTAL RUN
...
> factor < 1 and difference < 0 means '1.7.0' is faster.

Bert pointed out to me that these timings look reversed, and sure enough,
the arguments were swapped. It's correct but confusing: it says "1.37" and
"<1 means 1.7.0 is faster" -- used to say "<1 means trunk is faster".

Below are the same timings, with a few more 1.7.0 runs added, and in the
order we're all used to seeing them. Thanks, Bert ;)

Now I'm still trying to figure out why the N numbers are slightly different.
I thought I set the random seed explicitly so that each run ends up being
identical... we'll see about that.

~Neels

1.7.0_at_1181106 vs. trunk_at_1357617
Started at Thu Jul 5 15:44:20 UTC 2012

*Disclaimer* - This tests only file://-URL access on a GNU/Linux VM.
This is intended to measure changes in performance of the local working
copy layer, *only*. These results are *not* generally true for everyone.
(not running benchmarks, just printing results on record.)

Averaged-total results across all runs:
---------------------------------------

Above totals split into separate <dir-levels>x<dir-spread> runs:
----------------------------------------------------------------

More detail:
------------

Timings for 1.7.0,5x5
    N min max avg operation (unit is seconds)
    3 462.10 475.20 467.47 TOTAL RUN
  422 0.01 1.87 0.03 add
    6 0.02 5.86 2.87 checkout
   24 1.68 83.41 25.40 commit
    3 0.19 0.26 0.23 copy
    3 0.75 1.34 0.98 delete
   15 9.49 43.34 17.13 info
    6 7.18 20.65 13.67 merge
  481 0.01 0.32 0.01 mkdir
  122 0.01 0.13 0.01 propdel
6230 0.01 0.31 0.01 proplist
12681 0.01 0.64 0.01 propset
3212 0.01 0.39 0.01 ps
    6 0.01 0.02 0.01 resolve
    6 0.52 0.72 0.61 resolved
   42 0.21 1.30 0.57 status
    3 3.97 4.21 4.09 switch
   42 0.26 7.31 2.26 update

--
Timings for trunk,5x5
    N    min     max     avg   operation  (unit is seconds)
    3  337.11  347.03  343.28  TOTAL RUN
  418    0.01    1.75    0.02  add
    6    0.02    5.18    2.50  checkout
   24    2.04   85.18   24.94  commit
    3    0.25    0.31    0.28  copy
    3    0.66    0.72    0.68  delete
   15    1.69    3.94    2.31  info
    6    4.38   15.23    9.66  merge
  485    0.01    0.50    0.01  mkdir
  127    0.01    0.06    0.01  propdel
 6258    0.01    0.09    0.01  proplist
12683    0.01    0.24    0.01  propset
 3144    0.01    1.03    0.01  ps
    6    0.01    0.01    0.01  resolve
    6    0.34    0.86    0.54  resolved
   42    0.14    1.05    0.42  status
    3    2.72    4.40    3.31  switch
   42    0.21    6.30    1.89  update
--
Compare 1.7.0,5x5 to trunk_at_1357617,5x5
       N        min              max              avg         operation
      3/3    0.73|-124.993    0.73|-128.170    0.73|-124.193  TOTAL RUN
  422/418    0.69| -0.003     0.94| -0.116     0.82| -0.004   add
      6/6    0.77| -0.005     0.88| -0.684     0.87| -0.371   checkout
    24/24    1.21| +0.357     1.02| +1.771     0.98| -0.463   commit
      3/3    1.32| +0.061     1.23| +0.058     1.23| +0.053   copy
      3/3    0.88| -0.093     0.54| -0.618     0.69| -0.300   delete
    15/15    0.18| -7.799     0.09|-39.393     0.14|-14.818   info
      6/6    0.61| -2.801     0.74| -5.418     0.71| -4.010   merge
  481/485    0.69| -0.003     1.56| +0.181     0.85| -0.002   mkdir
  122/127    0.70| -0.003     0.48| -0.066     0.69| -0.004   propdel
    6K/6K    0.66| -0.003     0.31| -0.213     0.66| -0.004   proplist
  12K/12K    0.68| -0.003     0.38| -0.401     0.70| -0.004   propset
    3K/3K    0.69| -0.003     2.64| +0.638     0.72| -0.004   ps
      6/6    0.79| -0.002     0.66| -0.005     0.75| -0.003   resolve
      6/6    0.66| -0.178     1.21| +0.147     0.89| -0.070   resolved
    42/42    0.67| -0.070     0.81| -0.247     0.73| -0.152   status
      3/3    0.68| -1.254     1.05| +0.192     0.81| -0.787   switch
    42/42    0.83| -0.044     0.86| -1.014     0.83| -0.376   update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
 factor < 1 and difference < 0 means 'trunk_at_1357617,5x5' is faster.
 "2/3" means: '1.7.0,5x5' has 2 timings on record, the other has 3.)
Timings for 1.7.0,100x1
    N    min     max     avg   operation  (unit is seconds)
    3   29.37   30.52   29.90  TOTAL RUN
   73    0.01    0.17    0.02  add
    6    0.02    0.41    0.20  checkout
   24    0.36    3.66    1.69  commit
    3    0.18    0.25    0.21  copy
    3    0.11    0.12    0.12  delete
   15    0.17    0.61    0.30  info
    6    0.59    1.48    0.87  merge
   58    0.01    0.02    0.02  mkdir
   10    0.01    0.02    0.01  propdel
  353    0.01    0.02    0.01  proplist
  561    0.01    0.03    0.02  propset
  189    0.01    0.02    0.01  ps
    6    0.01    0.02    0.01  resolve
    6    0.06    0.11    0.08  resolved
   42    0.05    0.12    0.08  status
    3    0.38    0.44    0.41  switch
   42    0.05    0.91    0.30  update
--
Timings for trunk,100x1
    N    min     max     avg   operation  (unit is seconds)
    3   23.16   24.14   23.75  TOTAL RUN
   75    0.01    0.11    0.01  add
    6    0.02    0.31    0.16  checkout
   24    0.84    3.46    1.61  commit
    3    0.19    0.23    0.21  copy
    3    0.08    0.09    0.09  delete
   15    0.10    0.21    0.14  info
    6    0.39    0.62    0.48  merge
   65    0.01    0.01    0.01  mkdir
    8    0.01    0.01    0.01  propdel
  351    0.01    0.01    0.01  proplist
  565    0.01    0.08    0.01  propset
  182    0.01    0.01    0.01  ps
    6    0.01    0.01    0.01  resolve
    6    0.06    0.07    0.06  resolved
   42    0.03    0.08    0.05  status
    3    0.30    0.34    0.32  switch
   42    0.04    0.46    0.23  update
--
Compare 1.7.0,100x1 to trunk_at_1357617,100x1
       N        min              max              avg         operation
      3/3    0.79| -6.211     0.79| -6.377     0.79| -6.149   TOTAL RUN
    73/75    0.68| -0.004     0.65| -0.059     0.66| -0.007   add
      6/6    0.73| -0.007     0.76| -0.100     0.80| -0.042   checkout
    24/24    2.33| +0.480     0.95| -0.198     0.95| -0.076   commit
      3/3    1.02| +0.003     0.95| -0.013     0.98| -0.005   copy
      3/3    0.75| -0.028     0.76| -0.028     0.74| -0.030   delete
    15/15    0.60| -0.069     0.34| -0.400     0.47| -0.157   info
      6/6    0.66| -0.201     0.42| -0.866     0.55| -0.396   merge
    58/65    0.69| -0.004     0.58| -0.010     0.65| -0.006   mkdir
     10/8    0.69| -0.003     0.69| -0.005     0.68| -0.004   propdel
  353/351    0.64| -0.004     0.55| -0.011     0.60| -0.005   proplist
  561/565    0.69| -0.004     3.21| +0.058     0.65| -0.005   propset
  189/182    0.68| -0.004     0.57| -0.010     0.63| -0.006   ps
      6/6    0.79| -0.002     0.55| -0.007     0.72| -0.003   resolve
      6/6    0.95| -0.003     0.69| -0.033     0.80| -0.016   resolved
    42/42    0.70| -0.014     0.69| -0.036     0.70| -0.024   status
      3/3    0.79| -0.080     0.77| -0.098     0.79| -0.085   switch
    42/42    0.80| -0.010     0.51| -0.447     0.74| -0.079   update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
 factor < 1 and difference < 0 means 'trunk_at_1357617,100x1' is faster.
 "2/3" means: '1.7.0,100x1' has 2 timings on record, the other has 3.)
Timings for 1.7.0,1x100
    N    min     max     avg   operation  (unit is seconds)
    3    9.50   10.42    9.92  TOTAL RUN
    3    0.04    0.05    0.05  add
    6    0.02    0.14    0.08  checkout
   24    0.24    2.02    0.66  commit
    3    0.18    0.20    0.19  copy
    3    0.02    0.03    0.03  delete
   15    0.05    0.10    0.06  info
    6    0.16    0.34    0.23  merge
   12    0.01    0.02    0.01  propdel
  144    0.01    0.02    0.01  proplist
  294    0.01    0.02    0.01  propset
   93    0.01    0.02    0.01  ps
    6    0.01    0.02    0.01  resolve
    6    0.02    0.02    0.02  resolved
   42    0.01    0.04    0.02  status
    3    0.08    0.09    0.08  switch
   42    0.02    0.14    0.05  update
--
Timings for trunk,1x100
    N    min     max     avg   operation  (unit is seconds)
    3    8.32    8.68    8.48  TOTAL RUN
    3    0.04    0.04    0.04  add
    6    0.02    0.13    0.07  checkout
   24    0.18    1.84    0.62  commit
    3    0.15    0.22    0.19  copy
    3    0.02    0.02    0.02  delete
   15    0.05    0.09    0.06  info
    6    0.10    0.21    0.14  merge
   12    0.01    0.01    0.01  propdel
  144    0.01    0.01    0.01  proplist
  294    0.01    0.01    0.01  propset
   93    0.01    0.01    0.01  ps
    6    0.01    0.01    0.01  resolve
    6    0.01    0.02    0.01  resolved
   42    0.01    0.03    0.02  status
    3    0.06    0.07    0.06  switch
   42    0.02    0.11    0.04  update
--
Compare 1.7.0,1x100 to trunk_at_1357617,1x100
       N        min              max              avg         operation
      3/3    0.88| -1.175     0.83| -1.744     0.85| -1.443   TOTAL RUN
      3/3    0.82| -0.008     0.74| -0.014     0.80| -0.010   add
      6/6    0.76| -0.006     0.92| -0.011     0.89| -0.009   checkout
    24/24    0.78| -0.053     0.91| -0.172     0.95| -0.036   commit
      3/3    0.82| -0.033     1.14| +0.028     1.00| -0.001   copy
      3/3    0.86| -0.003     0.83| -0.004     0.84| -0.004   delete
    15/15    0.97| -0.001     0.94| -0.006     0.94| -0.003   info
      6/6    0.64| -0.056     0.61| -0.132     0.58| -0.098   merge
    12/12    0.71| -0.003     0.51| -0.010     0.66| -0.004   propdel
  144/144    0.68| -0.003     0.83| -0.003     0.67| -0.004   proplist
  294/294    0.72| -0.003     0.77| -0.004     0.71| -0.004   propset
    93/93    0.72| -0.003     0.66| -0.006     0.67| -0.004   ps
      6/6    0.89| -0.001     0.78| -0.004     0.80| -0.002   resolve
      6/6    0.70| -0.005     0.75| -0.006     0.74| -0.005   resolved
    42/42    0.74| -0.003     0.73| -0.010     0.77| -0.005   status
      3/3    0.73| -0.022     0.73| -0.024     0.74| -0.022   switch
    42/42    0.83| -0.003     0.82| -0.025     0.83| -0.009   update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
 factor < 1 and difference < 0 means 'trunk_at_1357617,1x100' is faster.
 "2/3" means: '1.7.0,1x100' has 2 timings on record, the other has 3.)
Timings for 1.7.0
    N    min     max     avg   operation  (unit is seconds)
    9    9.50  475.20  169.10  TOTAL RUN
  498    0.01    1.87    0.02  add
   18    0.02    5.86    1.05  checkout
   72    0.24   83.41    9.25  commit
    9    0.18    0.26    0.21  copy
    9    0.02    1.34    0.37  delete
   45    0.05   43.34    5.83  info
   18    0.16   20.65    4.93  merge
  539    0.01    0.32    0.01  mkdir
  144    0.01    0.13    0.01  propdel
 6727    0.01    0.31    0.01  proplist
13536    0.01    0.64    0.01  propset
 3494    0.01    0.39    0.01  ps
   18    0.01    0.02    0.01  resolve
   18    0.02    0.72    0.24  resolved
  126    0.01    1.30    0.22  status
    9    0.08    4.21    1.53  switch
  126    0.02    7.31    0.87  update
--
Timings for trunk
    N    min     max     avg   operation  (unit is seconds)
    9    8.32  347.03  125.17  TOTAL RUN
  496    0.01    1.75    0.02  add
   18    0.02    5.18    0.91  checkout
   72    0.18   85.18    9.06  commit
    9    0.15    0.31    0.23  copy
    9    0.02    0.72    0.26  delete
   45    0.05    3.94    0.84  info
   18    0.10   15.23    3.43  merge
  550    0.01    0.50    0.01  mkdir
  147    0.01    0.06    0.01  propdel
 6753    0.01    0.09    0.01  proplist
13542    0.01    0.24    0.01  propset
 3419    0.01    1.03    0.01  ps
   18    0.01    0.01    0.01  resolve
   18    0.01    0.86    0.21  resolved
  126    0.01    1.05    0.16  status
    9    0.06    4.40    1.23  switch
  126    0.02    6.30    0.72  update
--
Compare 1.7.0 to trunk_at_1357617
       N        min              max              avg         operation
      9/9    0.88| -1.175     0.73|-128.170    0.74|-43.928   TOTAL RUN
  498/496    0.69| -0.003     0.94| -0.116     0.80| -0.005   add
    18/18    0.77| -0.005     0.88| -0.684     0.87| -0.140   checkout
    72/72    0.78| -0.053     1.02| +1.771     0.98| -0.192   commit
      9/9    0.82| -0.033     1.23| +0.058     1.07| +0.016   copy
      9/9    0.86| -0.003     0.54| -0.618     0.70| -0.111   delete
    45/45    0.97| -0.001     0.09|-39.393     0.14| -4.993   info
    18/18    0.64| -0.056     0.74| -5.418     0.70| -1.501   merge
  539/550    0.69| -0.003     1.56| +0.181     0.82| -0.003   mkdir
  144/147    0.70| -0.003     0.48| -0.066     0.69| -0.004   propdel
    6K/6K    0.66| -0.003     0.31| -0.213     0.65| -0.004   proplist
  13K/13K    0.68| -0.003     0.38| -0.401     0.70| -0.004   propset
    3K/3K    0.69| -0.003     2.64| +0.638     0.71| -0.004   ps
    18/18    0.89| -0.001     0.78| -0.004     0.76| -0.003   resolve
    18/18    0.70| -0.005     1.21| +0.147     0.87| -0.030   resolved
  126/126    0.74| -0.003     0.81| -0.247     0.73| -0.060   status
      9/9    0.73| -0.022     1.05| +0.192     0.81| -0.298   switch
  126/126    0.83| -0.003     0.86| -1.014     0.82| -0.154   update
(legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
 factor < 1 and difference < 0 means 'trunk_at_1357617' is faster.
 "2/3" means: '1.7.0' has 2 timings on record, the other has 3.)

application/pgp-signature attachment: OpenPGP digital signature

Received on 2012-07-05 17:59:02 CEST

This message: [ Message body ]
Next message: Neels J Hofmeyr: "why does tortoise, wcng and cygwin break from icon caching?"
Previous message: C. Michael Pilato: "Re: svn commit: r1357654 - in /subversion/trunk/subversion/libsvn_wc: wc-queries.sql wc_db.c"
In reply to: neels_at_apache.org: "[svnbench] Revision: 1357620 compiled Jul 5 2012, 14:10:32"

Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]