Wikitcms

Wikitcms is a term used to refer to Fedora's use of this Mediawiki instance as an ad hoc test management system ('TCMS' stands for 'Test Case Management System', but that precise initialism is in fact quite rarely used). It is also the name of a Python module which provides an interface to the 'system'.

Background

The use of the Fedora wiki to track test results dates back to at least the page QA/FC6Test2TreeTesting - at that time, the Fedora wiki was a MoinMoin instance, not this Mediawiki instance. The rough form of a table with different tests as the rows and results as columns is visible even there. Since then, this basic format has been gradually elaborated.

• Separate test case pages were introduced in QA/TestResults/Fedora9Install/Alpha
• Live CD testing was introduced in QA/TestResults/Fedora9LiveCD/FinalRelease
• The first test result templates - Template:Testresult/fail, Template:Testresult/pass, and Template:Testresult/warn - were introduced in QA/TestResults/Fedora10Install/Final
• Result columns per architecture also first appeared in QA/TestResults/Fedora10Install/Final
• The first effort at associating bug reports with results was in QA:Fedora_11_Alpha_Install_Test_Results
• The first 'template' page (then used for manual copy/paste templating) for results pages was QA:Fedora_11_Install_Results_Template
• Separation of results pages by compose first occurred in Fedora 11, with TCs first appearing with Fedora 12
• The Test Results namespace (allowing result submission without a FAS account) was first used for Fedora 12
• The current Template:Result result template first appeared in Test_Results:Fedora_13_Alpha_TC1_Install
• The first of the current 'test types' other than Installation - Desktop - appeared in Test_Results:Fedora_13_Alpha_TC_Desktop (this also marked the introduction of result 'environments' other than architecture)
• The TC/RC result page naming scheme was more or less settled as of Fedora 13
• The Current (testtype) Results redirect pages first appeared with Fedora 13
• The Installation page was first split into sections in Test_Results:Fedora_14_Alpha_TC1_Install
• The Base and Security Lab test types appeared in Fedora 16 Alpha
• The first 'two-dimensional' result table (where the rows each represent the same test case in a different context, effectively using both rows and columns to represent environments) appeared in Test_Results:Fedora_20_Alpha_TC1_Install#ARM_disk_images
• The first (manual) result pages for nightly builds appeared in Fedora 21's pre-Alpha phase
• The Cloud and Server test types first appeared in Fedora 21 Alpha
• The template system for generating result pages, the CurrentFedoraCompose template, the wikitcms module, and the relval utility for generating result pages and reporting results were all introduced during the Fedora 21 cycle
• Individual nightly compose result pages and automatic generation of nightly result pages were introduced in Fedora 22