[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Test results on buildbot

From: Lieven Govaerts <svnlgo_at_mobsol.be>
Date: Mon, 30 Mar 2009 13:14:40 +0200

On Mon, Mar 30, 2009 at 1:08 AM, Branko Cibej <brane_at_xbc.nu> wrote:
> Bert Huijben wrote:
>> Recently the test framework was changed to support work-in-progress
>> tests. When this support was completed the Windows buildbot was offline.
>>
>> Since a few days the buildbot is back online (Thanks D.J. Heap!), and
>> for the last few days the Windows tests don't report an error in the
>> summary:
..
>
> Hm. I made sure that any failures reported from wimpy tests did not
> cause the tests to exit with non-zero status. Individual per-test
> results should be XPASS and XFAIL, too.
>
> IMHO buildbots should look at test exit status, not grep the log file;
> run-tests.py already does that better.
>

Buildbot does not and has never relied on parsing the log files. The
only indication it uses of failure state is by checking the return
value of the script ran by the slave. Note that in most cases this is
not 'make check' directly, but something like svncheck.sh or
svncheck.bat.

Lieven

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=1480832
Received on 2009-03-30 13:15:06 CEST

This is an archived mail posted to the Subversion Dev mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.