Hi Neels,
Would it be an idea to switch the baseline of the tests to 1.8.1? I
regularly look at them, but got confused with the reported performance gain.
Just to let you know :-)
Erik.
sent from my phone
On Jul 29, 2013 2:38 AM, <neels_at_apache.org> wrote:
> 1.7.0_at_1181106 vs. trunk_at_1507860
> Started at Mon Jul 29 00:26:13 UTC 2013
>
> *DISCLAIMER* - This tests only file://-URL access on a GNU/Linux VM.
> This is intended to measure changes in performance of the local working
> copy layer, *only*. These results are *not* generally true for everyone.
>
> Charts of this data are available at http://svn-qavm.apache.org/charts/
>
> Averaged-total results across all runs:
> ---------------------------------------
>
> Compare trunk_at_1507860 to 1.7.0
> N avg operation
> 51/9 0.54|-34.946 TOTAL RUN
> 3K/530 1.23| +0.005 add
> 102/18 0.76| -0.205 checkout
> 408/72 0.63| -0.741 commit
> 51/9 0.86| -0.003 copy
> 51/9 0.76| -0.070 delete
> 255/45 0.12| -3.828 info
> 102/18 0.52| -1.016 merge
> 2K/516 0.84| -0.002 mkdir
> 136/21 0.92| -0.001 propdel
> 38K/6K 0.73| -0.003 proplist
> 38K/6K 0.75| -0.003 propset
> 3K/591 0.77| -0.003 ps
> 102/18 1.92| +0.009 resolve
> 102/18 0.81| -0.038 resolved
> 714/126 0.71| -0.052 status
> 51/9 0.70| -0.326 switch
> 714/126 0.77| -0.157 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860' is faster.
> "2/3" means: '1.7.0' has 2 timings on record, the other has 3.)
>
>
> Above totals split into separate <dir-levels>x<dir-spread> runs:
> ----------------------------------------------------------------
>
> Compare trunk_at_1507860,5x5 to 1.7.0,5x5
> N avg operation
> 17/3 0.54|-95.838 TOTAL RUN
> 2K/456 1.25| +0.005 add
> 34/6 0.78| -0.499 checkout
> 136/24 0.64| -1.900 commit
> 17/3 0.80| -0.004 copy
> 17/3 0.78| -0.162 delete
> 85/15 0.11|-11.319 info
> 34/6 0.54| -2.567 merge
> 2K/470 0.83| -0.002 mkdir
> 136/20 0.91| -0.001 propdel
> 35K/6K 0.74| -0.002 proplist
> 36K/6K 0.76| -0.003 propset
> 2K/552 0.77| -0.002 ps
> 34/6 3.77| +0.024 resolve
> 34/6 0.80| -0.102 resolved
> 238/42 0.72| -0.125 status
> 17/3 0.73| -0.755 switch
> 238/42 0.82| -0.300 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860,5x5' is faster.
> "2/3" means: '1.7.0,5x5' has 2 timings on record, the other has 3.)
>
> Compare trunk_at_1507860,100x1 to 1.7.0,100x1
> N avg operation
> 17/3 0.55| -7.301 TOTAL RUN
> 476/71 0.98| -0.000 add
> 34/6 0.57| -0.083 checkout
> 136/24 0.50| -0.254 commit
> 17/3 0.90| -0.002 copy
> 17/3 0.67| -0.039 delete
> 85/15 0.47| -0.144 info
> 34/6 0.35| -0.378 merge
> 238/46 0.89| -0.002 mkdir
> 1K/337 0.62| -0.004 proplist
> 1K/273 0.65| -0.005 propset
> 119/33 0.66| -0.005 ps
> 34/6 1.32| +0.003 resolve
> 34/6 0.91| -0.006 resolved
> 238/42 0.68| -0.024 status
> 17/3 0.49| -0.185 switch
> 238/42 0.50| -0.151 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860,100x1' is faster.
> "2/3" means: '1.7.0,100x1' has 2 timings on record, the other has 3.)
>
> Compare trunk_at_1507860,1x100 to 1.7.0,1x100
> N avg operation
> 17/3 0.61| -1.698 TOTAL RUN
> 17/3 1.80| +0.042 add
> 34/6 0.63| -0.033 checkout
> 136/24 0.56| -0.070 commit
> 17/3 0.89| -0.002 copy
> 17/3 0.66| -0.010 delete
> 85/15 0.71| -0.020 info
> 34/6 0.41| -0.102 merge
> 629/111 0.59| -0.004 proplist
> 714/126 0.61| -0.005 propset
> 34/6 0.63| -0.004 ps
> 34/6 0.93| -0.001 resolve
> 34/6 0.67| -0.007 resolved
> 238/42 0.62| -0.008 status
> 17/3 0.56| -0.037 switch
> 238/42 0.65| -0.019 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860,1x100' is faster.
> "2/3" means: '1.7.0,1x100' has 2 timings on record, the other has 3.)
>
>
>
> More detail:
> ------------
>
> Timings for 1.7.0,5x5
> N min max avg operation (unit is seconds)
> 17 192.14 255.84 207.06 TOTAL RUN
> 2K 0.01 2.21 0.02 add
> 34 0.02 5.15 2.29 checkout
> 136 1.07 17.29 5.34 commit
> 17 0.01 0.13 0.02 copy
> 17 0.61 0.96 0.73 delete
> 85 6.32 31.69 12.70 info
> 34 5.31 8.49 5.60 merge
> 2K 0.01 0.04 0.01 mkdir
> 136 0.01 0.02 0.01 propdel
> 35K 0.01 0.03 0.01 proplist
> 36K 0.01 0.13 0.01 propset
> 2K 0.01 0.04 0.01 ps
> 34 0.01 0.01 0.01 resolve
> 34 0.40 0.70 0.51 resolved
> 238 0.17 0.96 0.44 status
> 17 2.70 3.02 2.80 switch
> 238 0.21 4.98 1.65 update
> --
> Timings for trunk_at_1507860,5x5
> N min max avg operation (unit is seconds)
> 3 108.04 116.63 111.22 TOTAL RUN
> 456 0.01 2.58 0.03 add
> 6 0.02 3.63 1.79 checkout
> 24 0.56 8.04 3.44 commit
> 3 0.02 0.02 0.02 copy
> 3 0.52 0.60 0.57 delete
> 15 0.60 2.11 1.38 info
> 6 2.32 3.79 3.04 merge
> 470 0.01 0.02 0.01 mkdir
> 20 0.01 0.02 0.01 propdel
> 6K 0.01 0.02 0.01 proplist
> 6K 0.01 0.06 0.01 propset
> 552 0.01 0.02 0.01 ps
> 6 0.03 0.04 0.03 resolve
> 6 0.30 0.56 0.41 resolved
> 42 0.11 0.54 0.32 status
> 3 2.03 2.06 2.04 switch
> 42 0.20 3.70 1.35 update
> --
> Compare trunk_at_1507860,5x5 to 1.7.0,5x5
> N min max avg operation
> 17/3 0.56|-84.091 0.46|-139.202 0.54|-95.838 TOTAL RUN
> 2K/456 1.05| +0.000 1.17| +0.372 1.25| +0.005 add
> 34/6 0.90| -0.002 0.70| -1.529 0.78| -0.499 checkout
> 136/24 0.52| -0.513 0.46| -9.253 0.64| -1.900 commit
> 17/3 1.12| +0.002 0.14| -0.114 0.80| -0.004 copy
> 17/3 0.85| -0.091 0.62| -0.362 0.78| -0.162 delete
> 85/15 0.09| -5.727 0.07|-29.575 0.11|-11.319 info
> 34/6 0.44| -2.991 0.45| -4.707 0.54| -2.567 merge
> 2K/470 0.96| -0.000 0.52| -0.020 0.83| -0.002 mkdir
> 136/20 0.88| -0.001 0.78| -0.005 0.91| -0.001 propdel
> 35K/6K 0.86| -0.001 0.75| -0.008 0.74| -0.002 proplist
> 36K/6K 0.85| -0.001 0.46| -0.068 0.76| -0.003 propset
> 2K/552 0.88| -0.001 0.48| -0.020 0.77| -0.002 ps
> 34/6 3.07| +0.017 4.31| +0.030 3.77| +0.024 resolve
> 34/6 0.74| -0.105 0.79| -0.148 0.80| -0.102 resolved
> 238/42 0.68| -0.053 0.56| -0.420 0.72| -0.125 status
> 17/3 0.75| -0.677 0.68| -0.966 0.73| -0.755 switch
> 238/42 0.93| -0.014 0.74| -1.283 0.82| -0.300 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860,5x5' is faster.
> "2/3" means: '1.7.0,5x5' has 2 timings on record, the other has 3.)
>
>
> Timings for 1.7.0,100x1
> N min max avg operation (unit is seconds)
> 17 12.78 22.57 16.21 TOTAL RUN
> 476 0.01 0.13 0.02 add
> 34 0.02 0.74 0.19 checkout
> 136 0.11 1.41 0.50 commit
> 17 0.02 0.03 0.02 copy
> 17 0.09 0.22 0.12 delete
> 85 0.14 0.80 0.27 info
> 34 0.45 0.91 0.58 merge
> 238 0.01 0.03 0.01 mkdir
> 1K 0.01 0.03 0.01 proplist
> 1K 0.01 0.03 0.01 propset
> 119 0.01 0.03 0.01 ps
> 34 0.01 0.02 0.01 resolve
> 34 0.05 0.17 0.07 resolved
> 238 0.04 0.21 0.08 status
> 17 0.33 0.65 0.36 switch
> 238 0.04 0.86 0.30 update
> --
> Timings for trunk_at_1507860,100x1
> N min max avg operation (unit is seconds)
> 3 8.67 9.29 8.91 TOTAL RUN
> 71 0.01 0.15 0.02 add
> 6 0.02 0.21 0.11 checkout
> 24 0.09 0.52 0.25 commit
> 3 0.02 0.02 0.02 copy
> 3 0.08 0.08 0.08 delete
> 15 0.09 0.19 0.13 info
> 6 0.18 0.23 0.20 merge
> 46 0.01 0.02 0.01 mkdir
> 1 0.01 0.01 0.01 propdel
> 337 0.01 0.01 0.01 proplist
> 273 0.01 0.01 0.01 propset
> 33 0.01 0.01 0.01 ps
> 6 0.01 0.01 0.01 resolve
> 6 0.06 0.07 0.06 resolved
> 42 0.03 0.12 0.05 status
> 3 0.18 0.18 0.18 switch
> 42 0.04 0.48 0.15 update
> --
> Compare trunk_at_1507860,100x1 to 1.7.0,100x1
> N min max avg operation
> 17/3 0.68| -4.110 0.41|-13.287 0.55| -7.301 TOTAL RUN
> 476/71 1.03| +0.000 1.15| +0.020 0.98| -0.000 add
> 34/6 0.92| -0.001 0.29| -0.526 0.57| -0.083 checkout
> 136/24 0.80| -0.023 0.37| -0.891 0.50| -0.254 commit
> 17/3 1.20| +0.003 0.55| -0.015 0.90| -0.002 copy
> 17/3 0.82| -0.017 0.36| -0.140 0.67| -0.039 delete
> 85/15 0.65| -0.050 0.23| -0.617 0.47| -0.144 info
> 34/6 0.41| -0.270 0.25| -0.680 0.35| -0.378 merge
> 238/46 0.90| -0.001 0.54| -0.016 0.89| -0.002 mkdir
> 1K/337 0.81| -0.001 0.30| -0.021 0.62| -0.004 proplist
> 1K/273 0.84| -0.001 0.36| -0.022 0.65| -0.005 propset
> 119/33 0.78| -0.002 0.33| -0.021 0.66| -0.005 ps
> 34/6 1.43| +0.003 0.69| -0.006 1.32| +0.003 resolve
> 34/6 1.30| +0.014 0.39| -0.103 0.91| -0.006 resolved
> 238/42 0.72| -0.011 0.56| -0.092 0.68| -0.024 status
> 17/3 0.53| -0.154 0.28| -0.469 0.49| -0.185 switch
> 238/42 0.90| -0.004 0.56| -0.381 0.50| -0.151 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860,100x1' is faster.
> "2/3" means: '1.7.0,100x1' has 2 timings on record, the other has 3.)
>
>
> Timings for 1.7.0,1x100
> N min max avg operation (unit is seconds)
> 17 3.06 7.30 4.36 TOTAL RUN
> 17 0.04 0.09 0.05 add
> 34 0.02 0.27 0.09 checkout
> 136 0.03 0.56 0.16 commit
> 17 0.01 0.03 0.02 copy
> 17 0.02 0.05 0.03 delete
> 85 0.04 0.19 0.07 info
> 34 0.12 0.31 0.17 merge
> 629 0.01 0.02 0.01 proplist
> 714 0.01 0.02 0.01 propset
> 34 0.01 0.02 0.01 ps
> 34 0.01 0.02 0.01 resolve
> 34 0.01 0.04 0.02 resolved
> 238 0.01 0.05 0.02 status
> 17 0.06 0.15 0.09 switch
> 238 0.02 0.27 0.05 update
> --
> Timings for trunk_at_1507860,1x100
> N min max avg operation (unit is seconds)
> 3 2.59 2.80 2.66 TOTAL RUN
> 3 0.07 0.15 0.10 add
> 6 0.02 0.09 0.06 checkout
> 24 0.02 0.27 0.09 commit
> 3 0.02 0.02 0.02 copy
> 3 0.02 0.02 0.02 delete
> 15 0.04 0.08 0.05 info
> 6 0.06 0.09 0.07 merge
> 111 0.01 0.01 0.01 proplist
> 126 0.01 0.01 0.01 propset
> 6 0.01 0.01 0.01 ps
> 6 0.01 0.01 0.01 resolve
> 6 0.01 0.02 0.01 resolved
> 42 0.01 0.02 0.01 status
> 3 0.05 0.05 0.05 switch
> 42 0.02 0.09 0.03 update
> --
> Compare trunk_at_1507860,1x100 to 1.7.0,1x100
> N min max avg operation
> 17/3 0.85| -0.463 0.38| -4.507 0.61| -1.698 TOTAL RUN
> 17/3 1.83| +0.030 1.71| +0.064 1.80| +0.042 add
> 34/6 0.95| -0.001 0.34| -0.177 0.63| -0.033 checkout
> 136/24 0.70| -0.010 0.48| -0.290 0.56| -0.070 commit
> 17/3 1.17| +0.002 0.62| -0.012 0.89| -0.002 copy
> 17/3 0.96| -0.001 0.44| -0.026 0.66| -0.010 delete
> 85/15 1.00| -0.000 0.41| -0.111 0.71| -0.020 info
> 34/6 0.50| -0.058 0.27| -0.226 0.41| -0.102 merge
> 629/111 0.83| -0.001 0.36| -0.012 0.59| -0.004 proplist
> 714/126 0.85| -0.001 0.39| -0.013 0.61| -0.005 propset
> 34/6 0.86| -0.001 0.39| -0.013 0.63| -0.004 ps
> 34/6 1.27| +0.002 0.59| -0.007 0.93| -0.001 resolve
> 34/6 0.82| -0.002 0.43| -0.022 0.67| -0.007 resolved
> 238/42 0.83| -0.002 0.51| -0.023 0.62| -0.008 status
> 17/3 0.79| -0.013 0.33| -0.098 0.56| -0.037 switch
> 238/42 0.99| -0.000 0.34| -0.176 0.65| -0.019 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860,1x100' is faster.
> "2/3" means: '1.7.0,1x100' has 2 timings on record, the other has 3.)
>
>
> Timings for 1.7.0
> N min max avg operation (unit is seconds)
> 51 3.06 255.84 75.88 TOTAL RUN
> 3K 0.01 2.21 0.02 add
> 102 0.02 5.15 0.86 checkout
> 408 0.03 17.29 2.00 commit
> 51 0.01 0.13 0.02 copy
> 51 0.02 0.96 0.29 delete
> 255 0.04 31.69 4.35 info
> 102 0.12 8.49 2.12 merge
> 2K 0.01 0.04 0.01 mkdir
> 136 0.01 0.02 0.01 propdel
> 38K 0.01 0.03 0.01 proplist
> 38K 0.01 0.13 0.01 propset
> 3K 0.01 0.04 0.01 ps
> 102 0.01 0.02 0.01 resolve
> 102 0.01 0.70 0.20 resolved
> 714 0.01 0.96 0.18 status
> 51 0.06 3.02 1.08 switch
> 714 0.02 4.98 0.67 update
> --
> Timings for trunk_at_1507860
> N min max avg operation (unit is seconds)
> 9 2.59 116.63 40.93 TOTAL RUN
> 530 0.01 2.58 0.03 add
> 18 0.02 3.63 0.65 checkout
> 72 0.02 8.04 1.26 commit
> 9 0.02 0.02 0.02 copy
> 9 0.02 0.60 0.22 delete
> 45 0.04 2.11 0.52 info
> 18 0.06 3.79 1.10 merge
> 516 0.01 0.02 0.01 mkdir
> 21 0.01 0.02 0.01 propdel
> 6K 0.01 0.02 0.01 proplist
> 6K 0.01 0.06 0.01 propset
> 591 0.01 0.02 0.01 ps
> 18 0.01 0.04 0.02 resolve
> 18 0.01 0.56 0.16 resolved
> 126 0.01 0.54 0.13 status
> 9 0.05 2.06 0.76 switch
> 126 0.02 3.70 0.51 update
> --
> Compare trunk_at_1507860 to 1.7.0
> N min max avg operation
> 51/9 0.85| -0.463 0.46|-139.202 0.54|-34.946 TOTAL RUN
> 3K/530 1.05| +0.000 1.17| +0.372 1.23| +0.005 add
> 102/18 0.92| -0.001 0.70| -1.529 0.76| -0.205 checkout
> 408/72 0.70| -0.010 0.46| -9.253 0.63| -0.741 commit
> 51/9 1.17| +0.002 0.14| -0.114 0.86| -0.003 copy
> 51/9 0.96| -0.001 0.62| -0.362 0.76| -0.070 delete
> 255/45 1.00| -0.000 0.07|-29.575 0.12| -3.828 info
> 102/18 0.50| -0.058 0.45| -4.707 0.52| -1.016 merge
> 2K/516 0.95| -0.000 0.52| -0.020 0.84| -0.002 mkdir
> 136/21 0.88| -0.001 0.78| -0.005 0.92| -0.001 propdel
> 38K/6K 0.84| -0.001 0.75| -0.008 0.73| -0.003 proplist
> 38K/6K 0.85| -0.001 0.46| -0.068 0.75| -0.003 propset
> 3K/591 0.87| -0.001 0.48| -0.020 0.77| -0.003 ps
> 102/18 1.27| +0.002 2.10| +0.021 1.92| +0.009 resolve
> 102/18 0.82| -0.002 0.79| -0.148 0.81| -0.038 resolved
> 714/126 0.83| -0.002 0.56| -0.420 0.71| -0.052 status
> 51/9 0.79| -0.013 0.68| -0.966 0.70| -0.326 switch
> 714/126 0.99| -0.000 0.74| -1.283 0.77| -0.157 update
> (legend: "1.23|+0.45" means: slower by factor 1.23 and by 0.45 seconds;
> factor < 1 and seconds < 0 means 'trunk_at_1507860' is faster.
> "2/3" means: '1.7.0' has 2 timings on record, the other has 3.)
>
>
>
> Had started at Mon Jul 29 00:26:13 UTC 2013,
> done at Mon Jul 29 00:36:36 UTC 2013
> wrote chart file:
> /home/neels/svnbench/charts/.busy/compare_1.7.0_trunk_at_last12.svg
> wrote chart file:
> /home/neels/svnbench/charts/.busy/compare_1.7.0_trunk_at_last12,5x5.svg
> wrote chart file:
> /home/neels/svnbench/charts/.busy/compare_1.7.0_trunk_at_last12,1x100.svg
> wrote chart file:
> /home/neels/svnbench/charts/.busy/compare_1.7.0_trunk_at_last12,100x1.svg
>
Received on 2013-07-30 19:52:03 CEST