Changes between Version 28 and Version 29 of TracDev/ReleaseTesting

Timestamp:

Jun 29, 2009, 8:03:59 PM (15 years ago)

Author:

Christian Boos

Comment:

add #TestingScenarios and some details about my various test configurations

TracDev/ReleaseTesting

@@ -7 +7 @@
 == What's expected of me? ==
 
-Not much :) At the beginning of the release testing period you will be added to the CC list of the release ticket, where you will find details on where to download the release candidate. The ticket might also mention additional information on specific areas/features to test. But in most cases it's enough to verify that the release works as expected on your system. Running the [TracDev/UnitTests unit tests] and [TracDev/FunctionalTests functional tests] and getting a green light would be a plus.
+Not much :) At the beginning of the release testing period you will be added to the CC list of the release ticket, where you will find details on where to download the release candidate. The ticket might also mention additional information on specific areas/features to test. But in most cases it's enough to verify that the release works as expected on your system. Running the [TracDev/UnitTests unit tests] and [TracDev/FunctionalTests functional tests] and getting a green light would be a plus. 
+See [#TestingScenarios Testing Scenarios] below for some suggestions.
 
 Once you have upgraded your server to the release candidate, please let us know by updating the release ticket. If you detect an issue, report it on that ticket as well.
@@ -14 +15 @@
 
 == Systems ==
+{{{
+#!comment
 
-||'''Contact''' ||'''Python''' ||'''Database Backend + Bindings''' ||'''Genshi''' ||'''Web Frontend''' ||'''OS''' ||'''Subversion'''||
-||JonasBorgstrom [[br]] trac.edgewall.org ||2.5     ||PostgreSQL 8.3 + psycopg2 2.0.8 ||0.6dev-!r999  ||lighttpd + fastcgi            ||Ubuntu 8.10 X86_64 || svn 1.5.1 ||
-||ChristianBoos                           ||2.4.4   ||SQLite 3.3.8 + PySqlite 2.5.0  ||0.6dev-!r1052 ||apache + mod_python           ||SLES9 x86_64       || svn 1.6.3 ||
+You really want to copy the following table and paste it into an external editor; best seen with 260 characters wide window...
+
+}}}
+
+||'''Contact''' ||'''Python''' ||'''Database Backend + Bindings''' ||'''Genshi''' ||'''Web Frontend''' ||'''OS''' ||'''Subversion'''||'''Testing'''||
+||JonasBorgstrom [[br]] trac.edgewall.org ||2.5     ||PostgreSQL 8.3 + psycopg2 2.0.8 ||0.6dev-!r999 ||lighttpd + fastcgi            ||Ubuntu 8.10 X86_64 || svn 1.5.1 ||''prod''||
+
+||ChristianBoos                           ||2.4.4   ||SQLite 3.3.8 + PySqlite 2.5.0  ||0.6dev-!r1052 ||apache + mod_python           ||SLES9 x86_64       || svn 1.6.3 ||''prod''||
+
+|| Note: no php ||2.6.1 [MSC v.1500 32 bit (Intel)]  ||MySQL server: "5.0.67-community-nt", client: "5.1.33", thread-safe: 1 + MySQLdb 1.2.3c1 ||0.6dev-!r1060 ||tracd ||Windows Vista (x64) sp1 ||svn 1.6.2 ||''dev''||
+|| ||                                                ||SQLite 3.5.9 + PySqlite 2.4.1                                                           || || || || || ''dev''||
+|| ||                                                ||PostgreSQL 8.3 + psycopg2 2.0.8                                                         || || || || || ''dev''||
+
+|| Note: no (docutils, php, pygments, pytz) ||!ActivePython 2.5.4 [MSC v.1310 32 bit (Intel)] ||MySQL server: "5.0.67-community-nt", client: "5.0.27", thread-safe: 1 + MySQLdb 1.2.2 ||0.6dev-!r1028 || || ||svn 1.6.3 ||''devlite''||
+|| ||                                                                                         ||SQLite 3.3.4 + PySqlite 2.3.2                                                         || || || || || ''devlite''||
+|| ||                                                                                         ||PostgreSQL 8.3 + psycopg2 2.0.10                                                      || || || || || ''devlite''||
+
+|| Note: no (lxml, svn, docutils, php, pygments, pytz) ||2.4.4 [MSC v.1310 32 bit (Intel)]    ||MySQL server: "5.0.67-community-nt", client: "5.0.27", thread-safe: 1 + MySQLdb 1.2.2 ||0.6dev-!r1052 || || || no svn ||''devlite''||
+|| ||                                                                                         ||SQLite 3.6.2 + PySqlite 2.5.1                                                         || || || || ||'' ''||
+|| ||                                                                                         ||PostgreSQL 8.3 + psycopg2 2.0.10 (dt dec ext pq3)                                     || || || || ||'' ''||
+
+|| Note: no (lxml, svn, docutils, php, pygments, pytz) ||2.3.5 [MSC v.1200 32 bit (Intel)]    ||SQLite 3.6.2 + PySqlite 2.5.1                                                         ||0.5.1 || || || no svn ||''devlite''||
+|| ||                                   ||PostgreSQL 8.3 + psycopg2 2.0.10                                                          || || || || ||''xxx''||
+
+
 ||RemyBlank                               ||2.3     ||SQLite 3.6.15                ||0.5-!r1051    ||tracd                         ||OS X 10.5          || svn 1.5.6 ||
-||                                        ||2.5     ||SQLite 3.6.13                ||0.5-!r1051    ||apache + mod_python           ||Gentoo x86         || svn 1.5.6  ||
+||                                        ||2.5     ||SQLite 3.6.12.6.1            ||0.5-!r1051    ||apache + mod_python           ||Gentoo x86         || svn 1.5.6  ||
+
 ||[mailto:shanec@activestate.com Shane Caraveo]||2.5     ||PostgreSQL 8.3               ||              ||apache, mod_python, virtualenv||OSX 10.5           ||           ||
 ||[mailto:techtonik@gmail.com Anatoly Techtonik]||2.4||MySQL 5.0.67|| ||apache, fastcgi, !DreamHost  ||Debian 3.1         ||           ||
@@ -27 +53 @@
 
 ''Please indicate your e-mail address under "Contact".''
+
+== Testing Scenarios ==
+The above configurations are used in to the following test conditions, along with corresponding expectations.
+=== ''prod''  ===
+ - version is used in "production", on a heavily used site (public or private)
+ - no regression or new defect should be reported by the users
+=== ''dev'' ===
+ - full test suite pass (both unit tests and functional tests)
+ - testing creation of a new environment, using a Trac mirror for the repository
+ - interactive testing of that new environment
+ - memory usage should stay steady and performance should be adequate
+=== ''devlite'' ===
+ - full test suite pass (both unit tests and functional tests)
+ - interactive testing of existing environment
+ - memory usage should stay steady and performance should be adequate
+
+(expand as needed)