Fedora 14 QA Retrospective: Difference between revisions

Revision as of 13:28, 27 September 2010

Introduction

This page is intended to gather feedback from the Fedora QA community on things that worked well and things that could have been better with the testing of Fedora 14. The feedback will be used as a basis for identifying areas for improvement for Fedora 14 testing. Any thoughts, big or small, are valuable. If someone already provided feedback similar to what you'd like to add, don't worry ... add your thoughts regardless.

For any questions or concerns, send mail to test@lists.fedoraproject.org.

Providing feedback

Gwjasu - I like ____ about the new ____ process

Adding feedback is fairly straight forward. If you already have a Fedora account ...

Login to the wiki
Select [Edit] for the appropriate section below.

Add your feedback using the format:

* ~~~ - I like ____ about the new ____ process

When done, Submit your changes

Otherwise, if you do not have a Fedora account, follow the instructions below ...

Select the appropriate page for your feedback...

Add your feedback using the format:

* ~~~ - I like ____ about the new ____ process

When done, Submit your changes

Feedback

Things that went well

jlaska - Beta released on time - Without a strong turn-out from the fedora-qa community, there is little chance that we would had the test results needed in order to properly assert that the beta release criteria had been met.

Could have been better

Fedora 16 alpha (Gnome) fails to complete properly (and does not give compliance warnings) when an NVIDIA Quadro FX3400SLI (HP Supplied) is installed in an HP XW4600 Workstation. (Works fine with NVIDIA GeForce similarly scaled cards). Under Fedora 15 (Gnome) the Quadro card reports no support under Gnome 3. - Cheers - reynolds@mira.net

jlaska - Beta RC delayed - Beta RC candidates were delivered late ... why? What can be improved next time?
jlaska - Fixing more than blockers - For F-14-Alpha, a new anaconda with 2 blocker bug fixes was requested, but the new version contained many more fixes. Question, did the additional bug fixes break anything?
- Recommendation - Early creation of f14-{alpha,beta,final} git branches for anaconda to allow for more control over commits.
jlaska - Root cause analysis - on why the following issues were discovered late
1. RHBZ #635396 - ConsoleKit session not properly opened (xfce)
2. RHBZ #635395 - ConsoleKit session not properly opened (lxde)
3. RHBZ #627789 - several users reporting problems installing from HD ISO due to this bug. However, testing RC3 showed no problems installing HD ISO ... there is a disconnect somewhere between the use case exercised and the test case?
jlaska - Beta RC delayed - Beta RC candidates were delivered late ... why? What can be improved next time?

Wishlist

I want a pony

Recommendations

After enough time has been given for feedback, the QA team will discuss and make recommendations on changes to prioritize for Fedora 14. This section organizes and lists the recommendations.

In order to coordinate efforts, and measure effectiveness of recommendations, please record and track any action taken in the Fedora 15 roadmap in the QA TRAC instance.

Coming soon...
Recommendations will arrive typically after problems have been diagnosed and improvements reviewed. This typically occurs after the release. Stay tuned ...

@@ Line 1: / Line 1: @@
-FIXME - this is just a placeholder for now ... more wiki magic coming
+== Introduction ==
-# f-14-alpha - a new anaconda with 2 blocker bug fixes was requested, but the new version contained many more fixes.
+This page is intended to gather feedback from the Fedora [[QA]] community on things that worked well and things that could have been better with the testing of Fedora 14.  The feedback will be used as a basis for identifying areas for improvement for Fedora 14 testing.  Any thoughts, big or small, are valuable.  If someone already provided feedback similar to what you'd like to add, don't worry ... add your thoughts regardless.
-#* ''Recommendation:'' Create f14-{alpha,beta,final} git branches for anaconda to allow for more control over commits.
-# Root cause analysis on why the following 2 issues were discovered late
+For any questions or concerns, send mail to [https://admin.fedoraproject.org/mailman/listinfo/test test@lists.fedoraproject.org].
+== Providing feedback ==
+* [[User:Gwjasu|Gwjasu]] - I like ____ about the new ____ process
+Adding feedback is fairly straight forward.  If you already have a [https://admin.fedoraproject.org/accounts Fedora account] ...
+# Login to the wiki
+# Select ''[Edit]'' for the appropriate section below.
+# Add your feedback using the format: <pre>* ~~~ - I like ____ about the new ____ process</pre>
+# When done, ''Submit'' your changes
+Otherwise, if you do not have a [https://admin.fedoraproject.org/accounts Fedora account], follow the instructions below ...
+# Select the appropriate page for your feedback...
+#* [http://fedoraproject.org/w/index.php?title=Test_Results:Fedora_14_QA_Retrospective/good&action=edit Something that worked well]
+#* [http://fedoraproject.org/w/index.php?title=Test_Results:Fedora_14_QA_Retrospective/bad&action=edit Something that didn't work well]
+#* [http://fedoraproject.org/w/index.php?title=Test_Results:Fedora_14_QA_Retrospective/wishlist&action=edit Anything on your QA wishlist]
+# Add your feedback using the format: <pre>* ~~~ - I like ____ about the new ____ process</pre>
+# When done, ''Submit'' your changes
+== Feedback ==
+=== Things that went well ===
+{{Test_Results:Fedora_14_QA_Retrospective/good}}
+# [[User:jlaska|jlaska]] - ''Beta released on time'' - Without a strong turn-out from the fedora-qa community, there is ''little'' chance that we would had the test results needed in order to properly assert that the beta release criteria had been met.
+=== Could have been better ===
+{{Test_Results:Fedora_14_QA_Retrospective/bad}}
+# [[User:jlaska|jlaska]] - ''Beta RC delayed'' - Beta RC candidates were delivered late ... why?  What can be improved next time?
+# [[User:jlaska|jlaska]] - ''Fixing more than blockers'' - For F-14-Alpha, a new anaconda with 2 blocker bug fixes was requested, but the new version contained many more fixes.  Question, did the additional bug fixes break anything?
+#* ''Recommendation'' - Early creation of f14-{alpha,beta,final} git branches for anaconda to allow for more control over commits.
+# [[User:jlaska|jlaska]] - ''Root cause analysis'' - on why the following issues were discovered late
 ## {{bz|635396}} - ConsoleKit session not properly opened (xfce)
 ## {{bz|635395}} - ConsoleKit session not properly opened (lxde)
 ## {{bz|627789}} - several users reporting problems installing from HD ISO due to this bug.  However, testing RC3 showed no problems installing HD ISO ... there is a disconnect somewhere between the use case exercised and the test case?
+# [[User:jlaska|jlaska]] - ''Beta RC delayed'' - Beta RC candidates were delivered late ... why?  What can be improved next time?
+=== Wishlist ===
+{{Test_Results:Fedora_14_QA_Retrospective/wishlist}}
+== Recommendations ==
+After enough time has been given for feedback, the [[QA]] team will discuss and make recommendations on changes to prioritize for Fedora 14.  This section organizes and lists the recommendations.
+In order to coordinate efforts, and measure effectiveness of recommendations, please record and track any action taken in the [https://fedorahosted.org/fedora-qa/milestone/Fedora%2015 Fedora 15 roadmap] in the [https://fedorahosted.org/fedora-qa QA TRAC instance].
+{{admon/tip|Coming soon...|Recommendations will arrive typically after problems have been diagnosed and improvements reviewed.  This typically occurs after the release.  Stay tuned ...}}
+== References ==
+* See [[Fedora_13_QA_Retrospective]]
+* See [[Fedora_12_QA_Retrospective]]
+* See [[Fedora_11_Retrospective_Notes]]
+<references/>
+[[Category:QA]]

Search