On Mon, Apr 18, 2011 at 9:50 AM, Neels Hofmeyr <neels_at_elego.de> wrote:
> On Fri, 2011-04-15 at 03:18 -0400, Greg Stein wrote:
>> On Fri, Apr 15, 2011 at 00:13, Daniel Shahaf <d.s_at_daniel.shahaf.name> wrote:
>> > Just add them to public version control?
>>
>> Already done. See tools/dev/benchmarks/suite1/
>>
>> Looking at the scripts (along with a bit of work that I did), it seems
>> quite easy to incorporate the 'run' script directly into
>> 'benchmark.py', and (thus) make it more portable to Windows devs.
>
> Thanks, Greg, for your tweaks! I've just merged mine and am now using
> tools/dev/benchmarks/suite1/ instead of the elego repos.
>
> BTW, what's in the repos in suite1/ is now *exactly* what is run on the
> VM, no tweaks, just 'svn co'. (because I've added two ifs conditional to
> my username, for the svn-bins path and the email address...)
> Oh, but the scripts on the VM are not automatically updated, so if you
> tweaked and want to see the changes in the weekly mail, do ping me.
>
> The benchmark will now run once a week on Monday morning and send
> results directly to dev@. Any objections?
What would be *really* nifty is if there was some kind of database
somewhere which captured all this information (for both this VM as
well as others who are running the tests). That way, somebody else
could do some analysis on it over time.
</wishful-thinking>
-Hyrum
Received on 2011-04-18 19:30:27 CEST