From Fedora Project Wiki

< FWN‎ | Beats

(create fwn 260 qa beat)
(qa beat for 262)
Line 10: Line 10:
=== Test Days ===
=== Test Days ===


This week sees the first Fedora 15 Test Day on 2011-01-27<ref>http://fedoraproject.org/wiki/Test_Day:2011-01-27_Network_Device_Naming_With_Biosdevname</ref>, on network device naming changes upcoming in Fedora 15. On compatible systems, Fedora 15 will use biosdevname<ref>http://linux.dell.com/biosdevname/</ref> to name the network interfaces; this provides a fully deterministic naming scheme on such systems, as opposed to the current system, where you cannot be sure that a given interface's name in Fedora will reflect its physical location or label. The Test Day will ensure this system is working correctly and also that it does not override existing preferred names on upgrades, so if you want to make sure this change has no unexpected consequences for you, make sure to come along to the Test Day! The testing involved will be easy and possible from a live image, and the Test Day page has instructions to find out if your hardware is involved in this change.
Thursday 2011-01-27 saw the first Fedora 15 Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2011-01-27_Network_Device_Naming_With_Biosdevname</ref>, on network device naming changes upcoming in Fedora 15. The event went successfully and exposed some bugs in the system. [[User:Jlaska|James Laska]] provided a wrap-up of the event<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/096886.html</ref>.


Next Thursday, 2011-02-03, will see the first of three planned Test Days on the GNOME 3 desktop<ref>http://fedoraproject.org/wiki/Test_Day:2011-02-03_GNOME3_Alpha</ref>, which is landing in Fedora 15. Mark it on your calendar!
Thursday 2011-02-03 was the first of three planned Test Days on the GNOME 3 desktop<ref>http://fedoraproject.org/wiki/Test_Day:2011-02-03_GNOME3_Alpha</ref>, which is landing in Fedora 15. With considerable help from the desktop team, the event was a great success, with a wide range of users providing some very good testing and unearthing many bugs. [[User:Adamwill|Adam Williamson]] provided a wrap-up of the event<ref>http://lists.fedoraproject.org/pipermail/test-announce/2011-February/000180.html</ref>.


<references/>
This Thursday, 2011-02-10, was due to be FreeIPA v2<ref>http://fedoraproject.org/wiki/Features/FreeIPAv2</ref> Test Day, but the event has been postponed to Tuesday 2011-02-15<ref>http://fedoraproject.org/wiki/Test_Day:2011-02-15_FreeIPAv2</ref> - update your calendars! IPA is an identity server, and 2.0 is a major revision due to land in Fedora 15. The Test Day will be checking that all the major changes work as intended. Existing IPA users are probably the most likely candidates for the event, but if you've been meaning to give IPA a try anyway, this might be the ideal time.


=== Refining Bugzilla messages on updated packages ===
Thursday 2011-02-17 will be Xfce 4.8<ref>http://fedoraproject.org/wiki/Features/Xfce48</ref> Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2011-02-17_Xfce</ref>, where we will be testing out all the new features of this major Xfce release and ensuring there are no regressions. If you're an Xfce user or just interested in alternative desktops, please come along and help test.
 
[[User:Lmacken|Luke Macken]] applied the patch from [[User:Fcami|François Cami]]<ref>http://fedorahosted.org/fedora-infrastructure/ticket/701</ref> to improve the comments Bodhi leaves on bugs when the status of an update changes.


<references/>
<references/>


=== Test case management system proposal and requirements ===
=== FUDCon Tempe ===


During the QA weekly meeting of 2011-01-24<ref>http://fedoraproject.org/wiki/QA/Meetings/20110124</ref>, [[User:Rhe|Rui He]] reported that she had completed the review of use cases<ref>http://fedoraproject.org/wiki/Tcms_use_cases</ref> and features<ref>http://fedoraproject.org/wiki/Tcms_use_cases</ref> in comparing the current Wiki-based system for managing test cases and the potential replacement, Nitrate<ref>http://fedoraproject.org/wiki/Nitrate</ref>. The next step is to identify must-have and nice-to-have features to see if any are missing from Nitrate, and write scripts to convert Wiki test cases into Nitrate test cases.
The QA team was out in force at FUDCon Tempe<ref>http://fedoraproject.org/wiki/FUDCon:Tempe_2011</ref>. [[User:Jlaska|James Laska]] gave an AutoQA Update presentation<ref>http://fedoraproject.org/w/uploads/1/1c/FUDCon_Tempe_-_AutoQA_presentation.odp</ref> and [[User:Adamwill|Adam Williamson]] provided two wrap-up posts<ref>http://www.happyassassin.net/2011/01/30/fudcon-day-1-5/</ref> <ref>http://www.happyassassin.net/2011/02/03/fudcon-days-1-5-to-3-and-the-aftermath/</ref>.


<references/>
<references/>


=== Multi-spin DVD review ===
=== AutoQA ===
 
On a request from David Nalley, some group members reviewed the proposed multi-spin DVD<ref>http://fedorahosted.org/fedora-qa/ticket/164</ref>. [[User:Johannbg|Jóhann Guðmundsson]] suggested testing boot and installation of each live environment on the DVD. [[User:Cwickert|Christoph Wickert]], the main proposer of the spin, agreed that this would be a good idea, but did not expect to hit any problems.


<references/>
[[User:Jlaska|James Laska]] created a patch<ref>http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001543.html</ref> to transfer AutoQA config files from the test server to the client. [[User:Wwoods|Will Woods]] posted a revised version of his dependency check test<ref>http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001552.html</ref>. [[User:Jskladan|Josef Skladanka]] updated his new koji watcher code<ref>http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001529.html</ref>.


=== Smolt graphics card generation extraction ===
The team also worked on making AutoQA more accessible to new developers. Josef set up a trac milestone called Finger Food<ref>http://fedorahosted.org/autoqa/milestone/Finger%20Food</ref> containing small tasks suitable for new developers, while [[User:Kparal|Kamil Paral]] wrote a wiki page documenting AutoQA development<ref>http://fedoraproject.org/wiki/AutoQA_Development</ref>.  
 
[[User:Adamwill|Adam Williamson]] suggested a project for anyone looking for one - extracting information on graphics card generations from Smolt<ref>http://www.happyassassin.net/2011/01/17/potential-project-for-someone-graphics-card-generations-in-smolt/</ref>. He explained that this would be useful for assessing the overall level of support for GNOME Shell in Fedora 15.


<references/>
<references/>


=== Package-specific and critical path test case process ===
=== Testing old Intel graphics in Fedora 15 ===
 
[[User:Jlaska|James Laska]] provided a script<ref>http://fedorahosted.org/fedora-qa/ticket/154#comment:39</ref> implementing searching for package-specific test cases meeting the categorization guidelines recently put into practice.
 
<references/>
 
=== AutoQA ===


The new koji watcher implementation submitted for review last week by [[User:Jskladan|Josef Skladanka]], and the dependency checking test submitted by [[User:Wwoods|Will Woods]], were both reviewed this week<ref>http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001521.html</ref> <ref>http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001526.html</ref> <ref>http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001503.html</ref> <ref>http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001522.html</ref>. The AutoQA team also identified an issue in Bodhi's use of -pending tags, which [[User:Lmacken|Luke Macken]] rapidly fixed.
Cornel Panceac reported several problems trying to load GNOME 3 in Fedora 15 on an old Intel graphics chipset<ref>http://lists.fedoraproject.org/pipermail/test/2011-January/096723.html</ref>, and wondered if this was expected behaviour. [[User:Adamwill|Adam Williamson]] explained<ref>http://lists.fedoraproject.org/pipermail/test/2011-January/096725.html</ref> that failure to support the GNOME Shell was normal, but the system should fall back smoothly to the 'classic' desktop mode, and failure to do that would be a bug. Cornel then reported the bug<ref>http://bugzilla.redhat.com/show_bug.cgi?id=673659</ref>.


<references/>
<references/>

Revision as of 03:12, 10 February 2011

QualityAssurance

In this section, we cover the activities of the QA team[1]. For more information on the work of the QA team and how you can get involved, see the Joining page[2].

Contributing Writer: Adam Williamson

  1. ↑ http://fedoraproject.org/wiki/QA
  2. ↑ http://fedoraproject.org/wiki/QA/Join

Test Days

Thursday 2011-01-27 saw the first Fedora 15 Test Day[1], on network device naming changes upcoming in Fedora 15. The event went successfully and exposed some bugs in the system. James Laska provided a wrap-up of the event[2].

Thursday 2011-02-03 was the first of three planned Test Days on the GNOME 3 desktop[3], which is landing in Fedora 15. With considerable help from the desktop team, the event was a great success, with a wide range of users providing some very good testing and unearthing many bugs. Adam Williamson provided a wrap-up of the event[4].

This Thursday, 2011-02-10, was due to be FreeIPA v2[5] Test Day, but the event has been postponed to Tuesday 2011-02-15[6] - update your calendars! IPA is an identity server, and 2.0 is a major revision due to land in Fedora 15. The Test Day will be checking that all the major changes work as intended. Existing IPA users are probably the most likely candidates for the event, but if you've been meaning to give IPA a try anyway, this might be the ideal time.

Thursday 2011-02-17 will be Xfce 4.8[7] Test Day[8], where we will be testing out all the new features of this major Xfce release and ensuring there are no regressions. If you're an Xfce user or just interested in alternative desktops, please come along and help test.

  1. ↑ http://fedoraproject.org/wiki/Test_Day:2011-01-27_Network_Device_Naming_With_Biosdevname
  2. ↑ http://lists.fedoraproject.org/pipermail/test/2011-February/096886.html
  3. ↑ http://fedoraproject.org/wiki/Test_Day:2011-02-03_GNOME3_Alpha
  4. ↑ http://lists.fedoraproject.org/pipermail/test-announce/2011-February/000180.html
  5. ↑ http://fedoraproject.org/wiki/Features/FreeIPAv2
  6. ↑ http://fedoraproject.org/wiki/Test_Day:2011-02-15_FreeIPAv2
  7. ↑ http://fedoraproject.org/wiki/Features/Xfce48
  8. ↑ http://fedoraproject.org/wiki/Test_Day:2011-02-17_Xfce

FUDCon Tempe

The QA team was out in force at FUDCon Tempe[1]. James Laska gave an AutoQA Update presentation[2] and Adam Williamson provided two wrap-up posts[3] [4].

  1. ↑ http://fedoraproject.org/wiki/FUDCon:Tempe_2011
  2. ↑ http://fedoraproject.org/w/uploads/1/1c/FUDCon_Tempe_-_AutoQA_presentation.odp
  3. ↑ http://www.happyassassin.net/2011/01/30/fudcon-day-1-5/
  4. ↑ http://www.happyassassin.net/2011/02/03/fudcon-days-1-5-to-3-and-the-aftermath/

AutoQA

James Laska created a patch[1] to transfer AutoQA config files from the test server to the client. Will Woods posted a revised version of his dependency check test[2]. Josef Skladanka updated his new koji watcher code[3].

The team also worked on making AutoQA more accessible to new developers. Josef set up a trac milestone called Finger Food[4] containing small tasks suitable for new developers, while Kamil Paral wrote a wiki page documenting AutoQA development[5].

  1. ↑ http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001543.html
  2. ↑ http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001552.html
  3. ↑ http://fedorahosted.org/pipermail/autoqa-devel/2011-January/001529.html
  4. ↑ http://fedorahosted.org/autoqa/milestone/Finger%20Food
  5. ↑ http://fedoraproject.org/wiki/AutoQA_Development

Testing old Intel graphics in Fedora 15

Cornel Panceac reported several problems trying to load GNOME 3 in Fedora 15 on an old Intel graphics chipset[1], and wondered if this was expected behaviour. Adam Williamson explained[2] that failure to support the GNOME Shell was normal, but the system should fall back smoothly to the 'classic' desktop mode, and failure to do that would be a bug. Cornel then reported the bug[3].

  1. ↑ http://lists.fedoraproject.org/pipermail/test/2011-January/096723.html
  2. ↑ http://lists.fedoraproject.org/pipermail/test/2011-January/096725.html
  3. ↑ http://bugzilla.redhat.com/show_bug.cgi?id=673659
Retrieved from "https://fedoraproject.org/w/index.php?title=FWN/Beats/QualityAssurance&oldid=220362"