[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Re: Test results on buildbot

From: Branko Cibej <brane_at_xbc.nu>
Date: Mon, 30 Mar 2009 01:08:32 +0200

Bert Huijben wrote:
> Recently the test framework was changed to support work-in-progress
> tests. When this support was completed the Windows buildbot was offline.
>
> Since a few days the buildbot is back online (Thanks D.J. Heap!), and
> for the last few days the Windows tests don't report an error in the
> summary:
>
> ===============
>
[...]
> =========================
>
> But the testresult is still failed (red) and broken builds are reported
> to the svn-breakage list.
>
> If I look in the raw log file I find 'FAIL:' lines for the
> work-in-progress patch tests, but those aren't reported in the summary
> (Maybe because it doesn't look for 'FAIL:' lines?).
>
> Could somebody please look at this issue?
>

Hm. I made sure that any failures reported from wimpy tests did not
cause the tests to exit with non-zero status. Individual per-test
results should be XPASS and XFAIL, too.

IMHO buildbots should look at test exit status, not grep the log file;
run-tests.py already does that better.

-- Brane

------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=1475068
Received on 2009-03-30 01:08:53 CEST

This is an archived mail posted to the Subversion Dev mailing list.