Hi Folks,
The earlier guidance was a great help. Specifically, this info from Daniel
on Apr 28:
> *_tests.py look by default for svn in ../../svn/svn --- i.e., build
> outputs. Are you running from a built source tree? If not, pass
> --bin=/usr/bin.
By using --bin=, I was able to run the tests successfully against my 1.6.15
installation.Daniel also informed me about the --help option. I suppose
that is a universal enough convention now in Subversion for this type of
script. However, as an old shell-script coder I was more used to "-h" or
just letting a script get chatty when wrong parameters are supplied.
Nico's posts (and Daniel's) on the subtleties of XFAIL are of interest,
because testing is probably going to be a big part of my job soon. I am
going to have to scan this thread a few more times before I fully
understand it.
Folks, I did try to study the testing READMEs and the info at
http://subversion.apache.org/docs/community-guide/building.html before I
posted here. I have recently Googled for sites that mention both
"basic_tests.py" and "man page", but without useful results.
If there's more in-depth documentation on basic_tests.py somewhere (besides
the script itself), I'd welcome some guidance here.
Many thanks,
Tom
On Sun, Apr 29, 2012 at 10:04 AM, Nico Kadel-Garcia <nkadel_at_gmail.com>
wrote:
>
>
> On Sun, Apr 29, 2012 at 8:54 AM, Daniel Shahaf <d.s_at_daniel.shahaf.name>
> wrote:
>>
>> Nico Kadel-Garcia wrote on Sun, Apr 29, 2012 at 08:48:27 -0400:
>> > On Sun, Apr 29, 2012 at 1:31 AM, Daniel Shahaf
>> > <d.s_at_daniel.shahaf.name>wrote:
>> >
>> > > Nico Kadel-Garcia wrote on Sat, Apr 28, 2012 at 21:38:59 -0400:
>> > >
>> > > > > SKIP and XFAIL are not errors. FAIL are errors. XPASS are not
>> > > supposed
>> > > > > to happen in release tarballs, but if they do they are treated
>> > > > > like
>> > > FAIL
>> > > > > is for the purposes of success/failure. The fact that your 'make
>> > > check'
>> > > > > exits non-zero despite having neither FAIL nor XPASS is a bug.
>> > > > >
>> > > > That's what I get for just posting the last few lines.
>> > >
>> > > Recent code prints FAILs after XFAILs and SKIPs, so I can safely say
>> > > that either you didn't have any FAILs or you posted the output of an
>> > > oldish version (1.6.x perhaps?).
>> > >
>> >
>> > 1.6.18, I';m afraid. This is on RHEL 5. Let me post the whole part of
>> > the
>> > build where it does the checks: Also note, the "make_check" gut turned
>> > off
>> > in the RHEL packages long before I arrived on the schene. The Fedora 17
>> > packages have the checks enabled, and they can pass on RHEL 6: RHEL 5
>> > and
>> > RHEL 4 both fail.
>> >
>> > Running all tests in utf8_tests.py [55/71]...FAILURE
>> > Running all tests in changes-test [68/71]...success
>>
>> All the Python tests failed, all the C tests passed. tests.log will
>> have more information.
>>
>> (Though: did it really take one hour? it should take under 10 minutes
>> without the Python tests)
>
>
> I only measured it with the python tests. (I leave out the ruby and java
> tests on RHEL 4, for which those components do not compile without
> ridiculous amounts of extra work due to out of date system components.)
>
>
>>
>> You can run
>> % make check TESTS="`echo subversion/tests/cmdline/utf8_tests.py`"
>> or
>> % cd subversion/tests/cmdline && ./utf8_tests.py
>> to skip the C tests (and all-but-one of the Python tests).
>
>
> That one shows:
>
> subversion-1.6.18]$ make check TESTS="`echo
> subversion/tests/cmdline/utf8_tests.py`"
> Running all tests in utf8_tests.py [1/1]...success
>
> At least one test was SKIPPED, checking
> /builddir/build/BUILD/subversion-1.6.18/tests.log
> SKIP: utf8_tests.py 1: conversion of paths and logs to/from utf8
> Summary of test results:
> 1 tests SKIPPED
>
> If I look at basic_test.py, I get a lot of errors. I've not had the time
or
> expertise with Python to go debugging these.
>
> svn:
>
'file:///builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svn-test-work/repositories/basic_tests-39.other/A/B/F'
> isn't in the same repository as
>
'file:///builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svn-test-work/repositories/basic_tests-39'
>
> Traceback (most recent call last):
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 1229, in run
> rc = self.pred.run(**kw)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/testcase.py",
> line 121, in run
> return self.func(sandbox)
> File "./basic_tests.py", line 1975, in basic_rm_urls_multi_repos
> F_url, C_url, F2_url, C2_url)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> line 202, in run_and_verify_svn
> expected_exit, *varargs)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> line 235, in run_and_verify_svn2
> exit_code, out, err = main.run_svn(want_err, *varargs)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 579, in run_svn
> return run_command(svn_binary, error_expected, 0,
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 356, in run_command
> None, *varargs)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 515, in run_command_stdin
> raise Failure
> Failure
> XFAIL: basic_tests.py 39: remotely remove directories from two
repositories
> EXCEPTION: SVNUnmatchedError
>
> Traceback (most recent call last):
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 1229, in run
> rc = self.pred.run(**kw)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/testcase.py",
> line 121, in run
> return self.func(sandbox)
> File "./basic_tests.py", line 2255, in info_nonexisting_file
> raise svntest.main.SVNUnmatchedError
> SVNUnmatchedError
> FAIL: basic_tests.py 41: get info on a file not in the repo
> ERROR: dump failed: svnadmin: Can't open file
> 'svn-test-work/local_tmp/repos/format': No such file or directory
> EXCEPTION: SVNRepositoryCopyFailure
>
> Traceback (most recent call last):
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 1229, in run
> rc = self.pred.run(**kw)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/testcase.py",
> line 121, in run
> return self.func(sandbox)
> File "./basic_tests.py", line 2266, in
> basic_relative_url_using_current_dir
> sbox.build()
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 1082, in build
> if actions.make_repo_and_wc(self, create_wc, read_only):
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> line 1393, in make_repo_and_wc
> guarantee_greek_repository(sbox.repo_dir)
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> line 119, in guarantee_greek_repository
> if main.copy_repos(main.pristine_dir, path, 1):
> File
>
"/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> line 804, in copy_repos
> raise SVNRepositoryCopyFailure
> SVNRepositoryCopyFailure
> FAIL: basic_tests.py 42: basic relative url target using current dir
> ERROR: dump failed: svnadmin: Can't open file
> 'svn-test-work/local_tmp/repos/format': No such file or directory
>
>
Received on 2012-04-30 15:56:10 CEST