On Mon, Mar 28, 2011 at 5:42 PM, John Beranek <john_at_redux.org.uk> wrote:
> On 25/03/2011 17:33, Mark Phippard wrote:
>> Hi,
>>
>> I have been working on a framework for writing tests to record
>> performance. I have something good enough to share:
>
> May I make an observation about these benchmarks...?
>
> When I provided some benchmarks that included 'checkout' tests I was
> specifically asked to make tests that separate WC and RA functionality.
>
> I did this, released results, and the (portable) benchmark code.
If your point is why didn't I use your code it is becuase it is in
Perl and I do not know Perl. I also did not see any conversation
happening around your benchmarks (or else I would not have bothered to
try get things going again).
I have tried to make it clear that this is just something I decided to
work on to help. Whether it means anything or not or whether we use
these benchmarks to make decisions remains to be seen. Feel free to
try to revive discussion around the tests you wrote, I will not be
offended.
> Now Mark has released a new set of benchmarks, which don't separate WC
> and RA functionality. No one has (yet) noted this fact. ;)
I focused my tests on WC functions. I am not sure what you mean by RA
functionality. Some of our biggest problems are in walking the tree
during things like update and commit. So we have to run those
commands in order to see the performance issues. I have created WC's
with three different "shapes" to show different areas where there
might be problems. I have avoided all purely RA functions like log
and I also do not bother to repeatedly show the results for commands
like checkout. I generally show it once for each shape working copy
and then just skip reporting how long it took in subsequent tests.
Anyway, I was not trying to offend you. I just wanted to help and I
have no desire to learn Perl (or even Python which obviously would
have been preferred). I was going to find the email where you posted
your tests, but since I never recalled anyone else running them or
discussing them I did not see the benefit in doing so and it would not
have accomplished my goal to help.
--
Thanks
Mark Phippard
http://markphip.blogspot.com/
Received on 2011-03-29 00:00:34 CEST