Tom Bing wrote on Mon, Apr 30, 2012 at 09:55:33 -0400:
> Hi Folks,
>
> The earlier guidance was a great help. Specifically, this info from Daniel
> on Apr 28:
>
> > *_tests.py look by default for svn in ../../svn/svn --- i.e., build
> > outputs. Are you running from a built source tree? If not, pass
> > --bin=/usr/bin.
>
> By using --bin=, I was able to run the tests successfully against my 1.6.15
> installation.Daniel also informed me about the --help option. I suppose
> that is a universal enough convention now in Subversion for this type of
> script. However, as an old shell-script coder I was more used to "-h" or
> just letting a script get chatty when wrong parameters are supplied.
>
-h works too. (-randomletter gives an error message that, unlike for
'svn' itself, doesn't mention --help.)
> Nico's posts (and Daniel's) on the subtleties of XFAIL are of interest,
> because testing is probably going to be a big part of my job soon. I am
> going to have to scan this thread a few more times before I fully
> understand it.
>
In addition to the scripts (and C programs) in subversion/tests/, you
may want to look at build/run_tests.py too. Feel free to ignore the
WIMP stuffs on first read.
> Folks, I did try to study the testing READMEs and the info at
> http://subversion.apache.org/docs/community-guide/building.html before I
> posted here. I have recently Googled for sites that mention both
> "basic_tests.py" and "man page", but without useful results.
>
> If there's more in-depth documentation on basic_tests.py somewhere (besides
> the script itself), I'd welcome some guidance here.
>
The docs we have are:
- subversion/tests/README
- subversion/tests/cmdline/README
- --help output
Other docs that might contain or point to useful info are:
- README
- perhaps http://subversion.apache.org/HACKING
If you have concrete suggestions (or patches) regarding how to improve
the tests' documentation, we'll be glad to hear them.
Cheers,
Daniel
> Many thanks,
> Tom
>
> On Sun, Apr 29, 2012 at 10:04 AM, Nico Kadel-Garcia <nkadel_at_gmail.com>
> wrote:
> >
> >
> > On Sun, Apr 29, 2012 at 8:54 AM, Daniel Shahaf <d.s_at_daniel.shahaf.name>
> > wrote:
> >>
> >> Nico Kadel-Garcia wrote on Sun, Apr 29, 2012 at 08:48:27 -0400:
> >> > On Sun, Apr 29, 2012 at 1:31 AM, Daniel Shahaf
> >> > <d.s_at_daniel.shahaf.name>wrote:
> >> >
> >> > > Nico Kadel-Garcia wrote on Sat, Apr 28, 2012 at 21:38:59 -0400:
> >> > >
> >> > > > > SKIP and XFAIL are not errors. FAIL are errors. XPASS are not
> >> > > supposed
> >> > > > > to happen in release tarballs, but if they do they are treated
> >> > > > > like
> >> > > FAIL
> >> > > > > is for the purposes of success/failure. The fact that your 'make
> >> > > check'
> >> > > > > exits non-zero despite having neither FAIL nor XPASS is a bug.
> >> > > > >
> >> > > > That's what I get for just posting the last few lines.
> >> > >
> >> > > Recent code prints FAILs after XFAILs and SKIPs, so I can safely say
> >> > > that either you didn't have any FAILs or you posted the output of an
> >> > > oldish version (1.6.x perhaps?).
> >> > >
> >> >
> >> > 1.6.18, I';m afraid. This is on RHEL 5. Let me post the whole part of
> >> > the
> >> > build where it does the checks: Also note, the "make_check" gut turned
> >> > off
> >> > in the RHEL packages long before I arrived on the schene. The Fedora 17
> >> > packages have the checks enabled, and they can pass on RHEL 6: RHEL 5
> >> > and
> >> > RHEL 4 both fail.
> >> >
> >> > Running all tests in utf8_tests.py [55/71]...FAILURE
> >> > Running all tests in changes-test [68/71]...success
> >>
> >> All the Python tests failed, all the C tests passed. tests.log will
> >> have more information.
> >>
> >> (Though: did it really take one hour? it should take under 10 minutes
> >> without the Python tests)
> >
> >
> > I only measured it with the python tests. (I leave out the ruby and java
> > tests on RHEL 4, for which those components do not compile without
> > ridiculous amounts of extra work due to out of date system components.)
> >
> >
> >>
> >> You can run
> >> % make check TESTS="`echo subversion/tests/cmdline/utf8_tests.py`"
> >> or
> >> % cd subversion/tests/cmdline && ./utf8_tests.py
> >> to skip the C tests (and all-but-one of the Python tests).
> >
> >
> > That one shows:
> >
> > subversion-1.6.18]$ make check TESTS="`echo
> > subversion/tests/cmdline/utf8_tests.py`"
> > Running all tests in utf8_tests.py [1/1]...success
> >
> > At least one test was SKIPPED, checking
> > /builddir/build/BUILD/subversion-1.6.18/tests.log
> > SKIP: utf8_tests.py 1: conversion of paths and logs to/from utf8
> > Summary of test results:
> > 1 tests SKIPPED
> >
> > If I look at basic_test.py, I get a lot of errors. I've not had the time
> or
> > expertise with Python to go debugging these.
> >
> > svn:
> >
> 'file:///builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svn-test-work/repositories/basic_tests-39.other/A/B/F'
> > isn't in the same repository as
> >
> 'file:///builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svn-test-work/repositories/basic_tests-39'
> >
> > Traceback (most recent call last):
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 1229, in run
> > rc = self.pred.run(**kw)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/testcase.py",
> > line 121, in run
> > return self.func(sandbox)
> > File "./basic_tests.py", line 1975, in basic_rm_urls_multi_repos
> > F_url, C_url, F2_url, C2_url)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> > line 202, in run_and_verify_svn
> > expected_exit, *varargs)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> > line 235, in run_and_verify_svn2
> > exit_code, out, err = main.run_svn(want_err, *varargs)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 579, in run_svn
> > return run_command(svn_binary, error_expected, 0,
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 356, in run_command
> > None, *varargs)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 515, in run_command_stdin
> > raise Failure
> > Failure
> > XFAIL: basic_tests.py 39: remotely remove directories from two
> repositories
> > EXCEPTION: SVNUnmatchedError
> >
> > Traceback (most recent call last):
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 1229, in run
> > rc = self.pred.run(**kw)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/testcase.py",
> > line 121, in run
> > return self.func(sandbox)
> > File "./basic_tests.py", line 2255, in info_nonexisting_file
> > raise svntest.main.SVNUnmatchedError
> > SVNUnmatchedError
> > FAIL: basic_tests.py 41: get info on a file not in the repo
> > ERROR: dump failed: svnadmin: Can't open file
> > 'svn-test-work/local_tmp/repos/format': No such file or directory
> > EXCEPTION: SVNRepositoryCopyFailure
> >
> > Traceback (most recent call last):
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 1229, in run
> > rc = self.pred.run(**kw)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/testcase.py",
> > line 121, in run
> > return self.func(sandbox)
> > File "./basic_tests.py", line 2266, in
> > basic_relative_url_using_current_dir
> > sbox.build()
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 1082, in build
> > if actions.make_repo_and_wc(self, create_wc, read_only):
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> > line 1393, in make_repo_and_wc
> > guarantee_greek_repository(sbox.repo_dir)
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/actions.py",
> > line 119, in guarantee_greek_repository
> > if main.copy_repos(main.pristine_dir, path, 1):
> > File
> >
> "/builddir/build/BUILD/subversion-1.6.18/subversion/tests/cmdline/svntest/main.py",
> > line 804, in copy_repos
> > raise SVNRepositoryCopyFailure
> > SVNRepositoryCopyFailure
> > FAIL: basic_tests.py 42: basic relative url target using current dir
> > ERROR: dump failed: svnadmin: Can't open file
> > 'svn-test-work/local_tmp/repos/format': No such file or directory
> >
> >
Received on 2012-04-30 16:13:42 CEST