[svn.haxx.se] · SVN Dev · SVN Users · SVN Org · TSVN Dev · TSVN Users · Subclipse Dev · Subclipse Users · this month's index

Status report of testsuite on trunk @ r24830

From: Lieven Govaerts <lgo_at_mobsol.be>
Date: 2007-04-30 01:13:06 CEST

I wrote a small script tonight to compare the status of the test suite
on trunk and the 1.4.x branch. Main goal is to check, before the release
of 1.5, that we're not introducing known regressions and fix all the
tests we possibly can.

Attached is the output of the script of trunk & branches/1.4.x at r24830.

Short summary for the impatient:
1. trunk has 795 tests compared to the 662 tests of 1.4.x (133 new tests!)
2. There are 3 regressions introduced on trunk, which as far as I'm
concerned are blocking issues for the next release.
3. There are 19 new non-passing tests added on trunk, we might want to
check which of those need fixing/implementation.

Lieven

Nr. of tests on 1.4.x: 662
Nr. of tests on trunk: 795 (= +133)

Regressions: Tests now failing on trunk!!:
 trunk: XFAIL - copy_tests.py svn cp PATH PATH replace file with props
 trunk: XFAIL - diff_tests.py basic diff summarize
 trunk: XFAIL - revert_tests.py revert svn cp PATH PATH replace file with props

Existing tests fixed on trunk:
 1.4.x: XFAIL - stat_tests.py run 'status -uN' with incoming changes
 1.4.x: XFAIL - commit_tests.py hook testing

Existing tests not fixed on trunk:
  SKIP - copy_tests.py executable bit should be preserved when copying
  SKIP - lock_tests.py svn:needs-lock and svn:executable, part I
  SKIP - lock_tests.py svn:needs-lock and svn:executable, part II
  SKIP - stat_tests.py status on versioned items replaced by symlinks
  SKIP - utf8_tests.py conversion of paths and logs to/from utf8
  SKIP - commit_tests.py tabs in paths
  SKIP - import_tests.py import of executable files
  SKIP - special_tests.py 'svn cp dir1 dir2' which contains a symlink
  SKIP - special_tests.py general symlink handling
  SKIP - special_tests.py import and export a symlink
  SKIP - special_tests.py remove a symlink
  SKIP - special_tests.py replace a normal file with a special file
  SKIP - special_tests.py replace a special file with a non-special file
  SKIP - ra-local-test.exe svn_ra_local__split_URL: invalid host names
  SKIP - schedule_tests.py revert: add some executable files
 XFAIL - fs-test.exe merging commit
 XFAIL - diff_tests.py diff a renamed directory
 XFAIL - authz_tests.py authz issue #2486 - open directory
 XFAIL - locks-test.exe able to reserve a name (lock non-existent path)
 XFAIL - locks-test.exe directory locks (kinda)
 XFAIL - merge_tests.py replace both dir and one of its children
 XFAIL - revert_tests.py revert a moved file
 XFAIL - switch_tests.py switch a file to a dir and back to the file

Failing tests added on trunk:
  SKIP - special_tests.py diff a symlink to a directory
  SKIP - special_tests.py merge file into symlink
  SKIP - special_tests.py merge symlink into file
 XFAIL - copy_tests.py copy added uncommitted paths with props
 XFAIL - copy_tests.py copy file using relative dst path names
 XFAIL - copy_tests.py move file using relative dst path names
 XFAIL - stat_tests.py status -v -N -u from different current directories
 XFAIL - depth_tests.py bring a dir into a depth-immediates working copy
 XFAIL - depth_tests.py bring a file into a depth-immediates working copy
 XFAIL - depth_tests.py commit a file from a depth-empty working copy
 XFAIL - depth_tests.py depth-1 working copy receives a deletion
 XFAIL - depth_tests.py depth-immediates working copy ignores a deletion
 XFAIL - depth_tests.py gradually update an empty wc to depth=infinity
 XFAIL - merge_tests.py discontinuous merges produce correct mergeinfo
 XFAIL - merge_tests.py handle eol-style propchange during merge
 XFAIL - merge_tests.py merge works when target has copied children
 XFAIL - switch_tests.py out of date propset should fail after a relocate
 XFAIL - update_tests.py update schedule-add copy of old rev
 XFAIL - update_tests.py update wc on the root of a Windows (virtual) drive

Passing tests added on trunk:
             authz_tests.py test authz for aliases
             basic_tests.py delete file and directory with --keep-local
             basic_tests.py use folders with names like 'c:hi'
          checkout_tests.py checkout with peg revision date
          checkout_tests.py co handles obstructing paths scheduled for add
          checkout_tests.py co with faux obstructions ok with --force
          checkout_tests.py co with obstructions should fail without --force
          checkout_tests.py co with real obstructions and unversioned files
          checkout_tests.py co with real obstructions ok with --force
          checkout_tests.py forced co fails if a dir obstructs a file
          checkout_tests.py forced co fails if a file obstructs a dir
          checkout_tests.py forced co with versioned obstruction
          checkout_tests.py import and checkout
            commit_tests.py commit files with inconsistent eol should fail
            commit_tests.py pre-commit hook failure case testing
            commit_tests.py set invalid revision props during remote mkdir
            commit_tests.py set multiple revision props during remote mkdir
            commit_tests.py set revision props during commit
            commit_tests.py set revision props during import
            commit_tests.py set revision props during remote delete
            commit_tests.py set revision props during remote mkdir
            commit_tests.py set revision props during remote property edit
            commit_tests.py set revision props during repos-to-repos copy
            commit_tests.py set revision props during repos-to-repos move
            commit_tests.py set revision props during wc-to-repos copy
            commit_tests.py set revprop without '=' during remote mkdir
            commit_tests.py set revprop without value ('') during remote mkdir
            commit_tests.py start-commit hook failure case testing
              copy_tests.py copy a copied file and dir
              copy_tests.py copy added path to URL
              copy_tests.py copy and move added paths without commits
              copy_tests.py copy file using relative src path names
              copy_tests.py copy local dirs using peg rev syntax
              copy_tests.py copy local files using peg rev syntax
              copy_tests.py copy multiple files from a repo to a wc
              copy_tests.py copy multiple files from a wc to a repo
              copy_tests.py copy multiple files within a repo
              copy_tests.py copy urls using peg rev syntax
              copy_tests.py move a copied file and dir
              copy_tests.py move a dir out of a moved dir
              copy_tests.py move a dir twice within a moved dir
              copy_tests.py move a file out of a moved dir
              copy_tests.py move a file twice within a moved dir
              copy_tests.py move a moved dir back to original location
              copy_tests.py move a moved file and dir
              copy_tests.py move a moved file back to original location
              copy_tests.py move file using relative src path names
              copy_tests.py move multiple files within a repo
              copy_tests.py svn cp multiple files to a common directory
              copy_tests.py svn mv multiple files to a common directory
             depth_tests.py act on a file in a depth-empty working copy
             depth_tests.py bring a dir into a depth-empty working copy
             depth_tests.py bring a dir into a mixed-depth working copy
             depth_tests.py depth-empty checkout
             depth_tests.py depth-empty working copy ignores a deletion
             depth_tests.py depth-files checkout
             depth_tests.py non-recursive checkout equals depth-files
             depth_tests.py update depth-empty wc shouldn't receive file mod
             depth_tests.py update depth-immediates wc gets top file mod only
             error-test.exe test svn_error_root_cause_is
         externals_tests.py use a peg revision to specify an external module
                fs-test.exe get mergeinfo
                fs-test.exe svn_fs_root_t (base) revisions
             merge_tests.py drive reporter api in depth first order
             merge_tests.py mark a revision range as merged
             merge_tests.py merge one file without explicit revisions
             merge_tests.py merge to switched path does not inherit or elide
             merge_tests.py mergeinfo elides to ancestor with identical info
             merge_tests.py merging a file w/no explicit target path or revs
             merge_tests.py target inherits mergeinfo from nearest ancestor
             merge_tests.py use inherited merge info to avoid repeated merge
             merge_tests.py use subtree's merge info to avoid repeated merge
         mergeinfo-test.exe diff of mergeinfo
         mergeinfo-test.exe intersection of rangelists
         mergeinfo-test.exe merging of mergeinfo hashs
         mergeinfo-test.exe parse broken single line mergeinfo
         mergeinfo-test.exe parse multi line mergeinfo
         mergeinfo-test.exe parse single line mergeinfo
         mergeinfo-test.exe parse single line mergeinfo and combine ranges
         mergeinfo-test.exe remove of mergeinfo
         mergeinfo-test.exe remove of rangelist
         mergeinfo-test.exe reversal of rangelist
         mergeinfo-test.exe turning mergeinfo back into a string
         mergeinfo-test.exe turning rangelist back into a string
              path-test.exe test svn_dirent_is_root
              path-test.exe test svn_path_check_valid
              path-test.exe test svn_path_compare_paths
              path-test.exe test svn_path_dirname
              path-test.exe test svn_path_get_longest_ancestor
              path-test.exe test svn_path_is_ancestor
              path-test.exe test svn_path_is_single_path_component
              path-test.exe test svn_path_splitext
              prop_tests.py commit with conflicting dirprops
              prop_tests.py receive properties on the wc root via update
              prop_tests.py test properties on replaced files
           special_tests.py checkout a repository containing symlinks
           special_tests.py checkout repository with unknown special file type
           special_tests.py replace a special file with a directory
              stat_tests.py run 'status --depth=X -u' with incoming changes
              stat_tests.py run 'status --depth=X' with local changes
              stat_tests.py run 'status -u' with locally deleted directories
          svnadmin_tests.py 'setlog' and 'setrevprop', bypassing hooks'
          svnadmin_tests.py recover a repository (FSFS only)
          svnadmin_tests.py verify a repository containing paths like 'c:hi'
           svnlook_tests.py test 'svnlook tree --non-recursive'
            switch_tests.py forced switch fails with some types of obstuctions
            switch_tests.py forced switch tolerates obstructions to adds
            switch_tests.py mergeinfo elides to closest ancestor w/ same info
            switch_tests.py switch a scheduled-add file
            update_tests.py forced up fails with some types of obstructions
            update_tests.py forced update tolerates obstructions to adds
            update_tests.py handle eol-style propchange during update
            update_tests.py update conflicted files
            update_tests.py update handles obstructing paths scheduled for add

Tests renamed on trunk:
              copy_tests.py 'move --force' should not lose local mods
                        to: 'move' should not lose local mods
        diff-diff3-test.exe merge with part already present (seed:488003684)
                        to: merge with part already present (seed:2209361605)
        diff-diff3-test.exe random 3-way merge (seed:488003684)
                        to: random 3-way merge (seed:2209361605)
        diff-diff3-test.exe random trivial merge (seed:488003684)
                        to: random trivial merge (seed:2209361605)
           fs-base-test.exe test svn_fs_base__canonicalize_abspath
                        to: test svn_fs__canonicalize_abspath
                fs-test.exe create and modify large file (seed=488019309)
                        to: create and modify large file (seed=2209549105)
                fs-test.exe create and modify medium file (seed=488019309)
                        to: create and modify medium file (seed=2209549105)
              lock_tests.py veriy unlocking with wrong lock token
                        to: verify unlocking with wrong lock token
              prop_tests.py write/read props in wc only (ps, pl, pdel)
                        to: write/read props in wc only (ps, pl, pdel, pe)
            random-test.exe random combine delta test, seed = 488175559
                        to: random combine delta test, seed = 2210033480
            random-test.exe random delta test, seed = 488175559
                        to: random delta test, seed = 2210033480
             repos-test.exe test svn_repos_dir_delta
                        to: test svn_repos_dir_delta2
               utf-test.exe test last_valid/last_valid2 (seed:488284934)
                        to: test last_valid/last_valid2 (seed:2210174105)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org
Received on Mon Apr 30 01:13:24 2007

This is an archived mail posted to the Subversion Dev mailing list.

This site is subject to the Apache Privacy Policy and the Apache Public Forum Archive Policy.