[TSVN] Regression Testing of TSVN

I emailed Stefan first with this idea to make sure it at least had his
tenative blessing.
 
I would be willing to create an automated test suite to run against the
nightly builds. The rub here is that there are no open source tools to
do this. Regression testing TSVN would require a functional testing tool
that can manipulate the UI. Go to OpensourceTesting.org, etc. and you
will find this is not an area well served by open source. Thus I would
probably be using TestComplete, which I prefer over any other testing
tool for windows and have a license for. I have no problem making the
test suite itself "open source" and available but others would have to
buy the product if they wanted to run the suite on an ongoing basis. The
nightly test results could also be published as XML. Anyone who wants
can contribute to the higher lever aspects of the test plan, procedures,
cases, etc. And I will become responsible for turning the test cases
into executable scripts in a test suite.

Comments???

--Greg

For those who want a little more detail:

IMHO, TestComplete does a better and more complete job of testing on
Windows platfroms than ANY other windows testing tool I've seen.
Attached are two quick sample recordings in a zip file. One is in
DelphiScript (my preference) and one in C++Script (probably more
familiar to most of you). TC lets you choose from several scripting
languages to use, but only one flavor can be used in any given project.
So you can follow along, the "test case" is basically: vigate to a file
and open it in notepad. Find a number and change it to its name
equivalent and then save the file. Use TSVN to commit it and capture the
commit comments to clipboard. Open a copy of notepad to paste in the
comments and close without saving. Use TSVN to do a show log (to see new
rev) and then close the dialog. Basically stop script at this point.

If you are familiar with automated testing, you know that recorded
scripts look nothing like the real tests. Real tests are parameterized,
refactored, made robust, actually check the values etc. However, the
scripts do illustrate that TC can do the necessary GUI manipulations.

I was one of the first beta testers of TC. It now supports unit,
functional, web, and load testing for virtually any language on Windows.
The main issue with TC from a marketing standpoint is that it is a more
programmer centric tool. Very powerful, but impossible to use by QA
people who don't even know how to write scripts. Programmers, and
testers who know you have to code to get extensible, robust, test suites
love it.

FYI, I primarily use Delphi (D7 to be exact). As I have it configured
(some key 3rd party plugins like coderush), is the best development
environment I know of. Again IMHO, still beats VS, Eclipse, and even the
later versions of Delphi (and I have all of those and I am more than
willing to switch to a better tool when I find it). Not trying to
convert, just letting you know my bias. <g> I am also aware that there
are many other factors beside technical/productivity for choosing one
tool over another.

--Greg

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tortoisesvn.tigris.org
For additional commands, e-mail: dev-help@tortoisesvn.tigris.org