I wrote a small script tonight to compare the status of the test suite
on trunk and the 1.4.x branch. Main goal is to check, before the release
of 1.5, that we're not introducing known regressions and fix all the
tests we possibly can.
Attached is the output of the script of trunk & branches/1.4.x at r24830.
Short summary for the impatient:
1. trunk has 795 tests compared to the 662 tests of 1.4.x (133 new tests!)
2. There are 3 regressions introduced on trunk, which as far as I'm
concerned are blocking issues for the next release.
3. There are 19 new non-passing tests added on trunk, we might want to
check which of those need fixing/implementation.
Lieven
Nr. of tests on 1.4.x: 662
Nr. of tests on trunk: 795 (= +133)
Regressions: Tests now failing on trunk!!:
trunk: XFAIL - copy_tests.py svn cp PATH PATH replace file with props
trunk: XFAIL - diff_tests.py basic diff summarize
trunk: XFAIL - revert_tests.py revert svn cp PATH PATH replace file with props
Existing tests fixed on trunk:
1.4.x: XFAIL - stat_tests.py run 'status -uN' with incoming changes
1.4.x: XFAIL - commit_tests.py hook testing
Existing tests not fixed on trunk:
SKIP - copy_tests.py executable bit should be preserved when copying
SKIP - lock_tests.py svn:needs-lock and svn:executable, part I
SKIP - lock_tests.py svn:needs-lock and svn:executable, part II
SKIP - stat_tests.py status on versioned items replaced by symlinks
SKIP - utf8_tests.py conversion of paths and logs to/from utf8
SKIP - commit_tests.py tabs in paths
SKIP - import_tests.py import of executable files
SKIP - special_tests.py 'svn cp dir1 dir2' which contains a symlink
SKIP - special_tests.py general symlink handling
SKIP - special_tests.py import and export a symlink
SKIP - special_tests.py remove a symlink
SKIP - special_tests.py replace a normal file with a special file
SKIP - special_tests.py replace a special file with a non-special file
SKIP - ra-local-test.exe svn_ra_local__split_URL: invalid host names
SKIP - schedule_tests.py revert: add some executable files
XFAIL - fs-test.exe merging commit
XFAIL - diff_tests.py diff a renamed directory
XFAIL - authz_tests.py authz issue #2486 - open directory
XFAIL - locks-test.exe able to reserve a name (lock non-existent path)
XFAIL - locks-test.exe directory locks (kinda)
XFAIL - merge_tests.py replace both dir and one of its children
XFAIL - revert_tests.py revert a moved file
XFAIL - switch_tests.py switch a file to a dir and back to the file
Failing tests added on trunk:
SKIP - special_tests.py diff a symlink to a directory
SKIP - special_tests.py merge file into symlink
SKIP - special_tests.py merge symlink into file
XFAIL - copy_tests.py copy added uncommitted paths with props
XFAIL - copy_tests.py copy file using relative dst path names
XFAIL - copy_tests.py move file using relative dst path names
XFAIL - stat_tests.py status -v -N -u from different current directories
XFAIL - depth_tests.py bring a dir into a depth-immediates working copy
XFAIL - depth_tests.py bring a file into a depth-immediates working copy
XFAIL - depth_tests.py commit a file from a depth-empty working copy
XFAIL - depth_tests.py depth-1 working copy receives a deletion
XFAIL - depth_tests.py depth-immediates working copy ignores a deletion
XFAIL - depth_tests.py gradually update an empty wc to depth=infinity
XFAIL - merge_tests.py discontinuous merges produce correct mergeinfo
XFAIL - merge_tests.py handle eol-style propchange during merge
XFAIL - merge_tests.py merge works when target has copied children
XFAIL - switch_tests.py out of date propset should fail after a relocate
XFAIL - update_tests.py update schedule-add copy of old rev
XFAIL - update_tests.py update wc on the root of a Windows (virtual) drive
Passing tests added on trunk:
authz_tests.py test authz for aliases
basic_tests.py delete file and directory with --keep-local
basic_tests.py use folders with names like 'c:hi'
checkout_tests.py checkout with peg revision date
checkout_tests.py co handles obstructing paths scheduled for add
checkout_tests.py co with faux obstructions ok with --force
checkout_tests.py co with obstructions should fail without --force
checkout_tests.py co with real obstructions and unversioned files
checkout_tests.py co with real obstructions ok with --force
checkout_tests.py forced co fails if a dir obstructs a file
checkout_tests.py forced co fails if a file obstructs a dir
checkout_tests.py forced co with versioned obstruction
checkout_tests.py import and checkout
commit_tests.py commit files with inconsistent eol should fail
commit_tests.py pre-commit hook failure case testing
commit_tests.py set invalid revision props during remote mkdir
commit_tests.py set multiple revision props during remote mkdir
commit_tests.py set revision props during commit
commit_tests.py set revision props during import
commit_tests.py set revision props during remote delete
commit_tests.py set revision props during remote mkdir
commit_tests.py set revision props during remote property edit
commit_tests.py set revision props during repos-to-repos copy
commit_tests.py set revision props during repos-to-repos move
commit_tests.py set revision props during wc-to-repos copy
commit_tests.py set revprop without '=' during remote mkdir
commit_tests.py set revprop without value ('') during remote mkdir
commit_tests.py start-commit hook failure case testing
copy_tests.py copy a copied file and dir
copy_tests.py copy added path to URL
copy_tests.py copy and move added paths without commits
copy_tests.py copy file using relative src path names
copy_tests.py copy local dirs using peg rev syntax
copy_tests.py copy local files using peg rev syntax
copy_tests.py copy multiple files from a repo to a wc
copy_tests.py copy multiple files from a wc to a repo
copy_tests.py copy multiple files within a repo
copy_tests.py copy urls using peg rev syntax
copy_tests.py move a copied file and dir
copy_tests.py move a dir out of a moved dir
copy_tests.py move a dir twice within a moved dir
copy_tests.py move a file out of a moved dir
copy_tests.py move a file twice within a moved dir
copy_tests.py move a moved dir back to original location
copy_tests.py move a moved file and dir
copy_tests.py move a moved file back to original location
copy_tests.py move file using relative src path names
copy_tests.py move multiple files within a repo
copy_tests.py svn cp multiple files to a common directory
copy_tests.py svn mv multiple files to a common directory
depth_tests.py act on a file in a depth-empty working copy
depth_tests.py bring a dir into a depth-empty working copy
depth_tests.py bring a dir into a mixed-depth working copy
depth_tests.py depth-empty checkout
depth_tests.py depth-empty working copy ignores a deletion
depth_tests.py depth-files checkout
depth_tests.py non-recursive checkout equals depth-files
depth_tests.py update depth-empty wc shouldn't receive file mod
depth_tests.py update depth-immediates wc gets top file mod only
error-test.exe test svn_error_root_cause_is
externals_tests.py use a peg revision to specify an external module
fs-test.exe get mergeinfo
fs-test.exe svn_fs_root_t (base) revisions
merge_tests.py drive reporter api in depth first order
merge_tests.py mark a revision range as merged
merge_tests.py merge one file without explicit revisions
merge_tests.py merge to switched path does not inherit or elide
merge_tests.py mergeinfo elides to ancestor with identical info
merge_tests.py merging a file w/no explicit target path or revs
merge_tests.py target inherits mergeinfo from nearest ancestor
merge_tests.py use inherited merge info to avoid repeated merge
merge_tests.py use subtree's merge info to avoid repeated merge
mergeinfo-test.exe diff of mergeinfo
mergeinfo-test.exe intersection of rangelists
mergeinfo-test.exe merging of mergeinfo hashs
mergeinfo-test.exe parse broken single line mergeinfo
mergeinfo-test.exe parse multi line mergeinfo
mergeinfo-test.exe parse single line mergeinfo
mergeinfo-test.exe parse single line mergeinfo and combine ranges
mergeinfo-test.exe remove of mergeinfo
mergeinfo-test.exe remove of rangelist
mergeinfo-test.exe reversal of rangelist
mergeinfo-test.exe turning mergeinfo back into a string
mergeinfo-test.exe turning rangelist back into a string
path-test.exe test svn_dirent_is_root
path-test.exe test svn_path_check_valid
path-test.exe test svn_path_compare_paths
path-test.exe test svn_path_dirname
path-test.exe test svn_path_get_longest_ancestor
path-test.exe test svn_path_is_ancestor
path-test.exe test svn_path_is_single_path_component
path-test.exe test svn_path_splitext
prop_tests.py commit with conflicting dirprops
prop_tests.py receive properties on the wc root via update
prop_tests.py test properties on replaced files
special_tests.py checkout a repository containing symlinks
special_tests.py checkout repository with unknown special file type
special_tests.py replace a special file with a directory
stat_tests.py run 'status --depth=X -u' with incoming changes
stat_tests.py run 'status --depth=X' with local changes
stat_tests.py run 'status -u' with locally deleted directories
svnadmin_tests.py 'setlog' and 'setrevprop', bypassing hooks'
svnadmin_tests.py recover a repository (FSFS only)
svnadmin_tests.py verify a repository containing paths like 'c:hi'
svnlook_tests.py test 'svnlook tree --non-recursive'
switch_tests.py forced switch fails with some types of obstuctions
switch_tests.py forced switch tolerates obstructions to adds
switch_tests.py mergeinfo elides to closest ancestor w/ same info
switch_tests.py switch a scheduled-add file
update_tests.py forced up fails with some types of obstructions
update_tests.py forced update tolerates obstructions to adds
update_tests.py handle eol-style propchange during update
update_tests.py update conflicted files
update_tests.py update handles obstructing paths scheduled for add
Tests renamed on trunk:
copy_tests.py 'move --force' should not lose local mods
to: 'move' should not lose local mods
diff-diff3-test.exe merge with part already present (seed:488003684)
to: merge with part already present (seed:2209361605)
diff-diff3-test.exe random 3-way merge (seed:488003684)
to: random 3-way merge (seed:2209361605)
diff-diff3-test.exe random trivial merge (seed:488003684)
to: random trivial merge (seed:2209361605)
fs-base-test.exe test svn_fs_base__canonicalize_abspath
to: test svn_fs__canonicalize_abspath
fs-test.exe create and modify large file (seed=488019309)
to: create and modify large file (seed=2209549105)
fs-test.exe create and modify medium file (seed=488019309)
to: create and modify medium file (seed=2209549105)
lock_tests.py veriy unlocking with wrong lock token
to: verify unlocking with wrong lock token
prop_tests.py write/read props in wc only (ps, pl, pdel)
to: write/read props in wc only (ps, pl, pdel, pe)
random-test.exe random combine delta test, seed = 488175559
to: random combine delta test, seed = 2210033480
random-test.exe random delta test, seed = 488175559
to: random delta test, seed = 2210033480
repos-test.exe test svn_repos_dir_delta
to: test svn_repos_dir_delta2
utf-test.exe test last_valid/last_valid2 (seed:488284934)
to: test last_valid/last_valid2 (seed:2210174105)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Received on Mon Apr 30 01:13:24 2007