From Fedora Project Wiki
Attendees
People present (lines said)
Regrets:
Agenda
Previous meeting follow-up
Fedora 13 RC test status
Upcoming test milestones:
- 2010-04-16 - Final Blocker Meeting (f13blocker) #1 (recap)
- 2010-04-16 - Pre-RC Branched Acceptance Test Plan
- 2010-04-23 - Final Blocker Meeting (f13blocker) #2
- 2010-04-29 - Test 'Final' Test Compose
- 2010-04-30 - Final Blocker Meeting (f13blocker) #3
- 2010-05-05 - Final Blocker Meeting (f13blocker) #4
- 2010-05-06 - Test 'Final' RC
Upcoming test days:
- 2010-04-22 - Test_Day:2010-04-22_StorageFiltering
- 2010-04-29 - Test_Day:2010-04-29_Preupgrade
Fedora 13 QA Retrospective
Ideas have already been coming in since F-13-Alpha. It's not too early to note QA issues you felt where handled well, or could have been improved. Your ideas will be used during F-14 QA goal planning. Voice your comments at Fedora_13_QA_Retrospective.
Ideas have already been coming in since F-13-Alpha. It's not too early to note QA issues you felt where handled well, or could have been improved. Your ideas will be used during F-14 QA goal planning. Voice your comments at Fedora_13_QA_Retrospective.
Questions:
- fenris02 - asked how to update boot.fedoraproject.org configs to use F-13-Beta. Jlaska noted that the configs appeared updated in (infrastructure.git), but promised to follow-up with fenris02' after the meeting
Bodhi QA workflow status check-in
- adamw asked lmacken and mathieu for a heads up as to when the improved feedback system will be available. Adamw noted that mathieu is working on it in the 'tg2 branch' (turbogears 2). Jlaska asked if there were requirements for bodhi-2 posted, adamw indicated that his earlier email, and dledford's, were being used as the initial requirements.
Proventesters check-in
- Adam Miller asked whether a vote was needed to move things forward. Adam Williamson offered sending a final draft mail to the list, noting the policy would go into effect if no serious objections surface.
- After the final draft, jlaska asked what steps should follow. The group came up with:
- Submit a ticket to create proventester FAS group
- Email test@l.fp.org to invite people to apply to proventester group
- Flesh out some test guidance for members of the proventester group (links to QA:Package_update_acceptance_test_plan or Category:Test_Cases).
Package Acceptance Test Plan check-in
- Kamil Paral discussed the current state of the [[1]]. Kamil noted that we can have the test plan completed before F-13 is released, but work to automate the test plan won't be completed and will be tracked separately as a combination of AutoQA milestones (Package Sanity Test, Resultsdb, depcheck).
- Kamil plans to send a final draft to the test@l.fp.org list for review. AdamW pointed out he was pretty please with the state of the test plan.
AutoQA check-in
There has been a lot of AutoQA activities in recent weeks, Jlaska asked the group to walk through some highlights.
Josef Skladanka updated the group on several AutoQA activities:
- Getting URLs of test results from AutoQA testruns is nearly finished. Patches out for review on autoqa-devel@lists.fedorahosted.org
- The beakerlib-based initscript test is now in production (see sample results)
- Making progress on the resultsDB - We have finished the db schema (see AutoQA_resultsdb_schema) and accepted a input API (see AutoQA_resultsdb_API)
- Next steps ...
- Prototyping the resultsdb and using an XMLRPC based API to populate with results (jlaska, 16:06:12)
- Creating a front-end which will be used for review/publish the data
Kamil Páral updated the group on his AutoQA focus areas:
- In addition to the notes above from Josef, working with Petr Splichal to automate the QA:Package_Sanity_Test_Plan (track plans using the autoqa PST milestone).
- Package Sanity ensures clean install, removal, upgrade, etc of the packages (see sample test output). There is already a 'pst' script in the repository which you can try to perform sanity tests on a downloaded package or package in a repo.
- Next steps ...
- detect that new updates are pushed to bodhi
- download the package and all relevant packages
Will Woods provide some updates on his AutoQA focus areas:
- We have enough info about current bodhi to write a bodhi update watcher, but it may have some shortcomings and will soon be obsoleted
- We have a proposed storage encoding for putting test plan metadata in the wiki (see QA:Test_Plan_Metadata_Test_Page), this will be used by the resultsdb
Open discussion - <Your topic here>
Upcoming QA events
- 2010-01-21 - Pre-Alpha Rawhide Acceptance Test Plan #1
- 2010-01-28 - Pre-Alpha Rawhide Acceptance Test Plan #2
- 2010-02-04 - Pre-Alpha Rawhide Acceptance Test Plan #3
- 2010-02-04 - NFSv4 Test Day
- 2010-02-05 - Alpha Blocker Meeting (F13Alpha) #1 (recap)
- 2010-02-11 - Test Alpha 'Test Compose' (boot media testing)
- 2010-02-12 - Alpha Blocker Meeting (F13Alpha) #2 (recap)
- 2010-02-12 - Alpha Test Candidate verification (announcement)
- 2010-02-18 - Alpha Release Candidate verification
- 2010-02-18 - Color Management test day
- 2010-02-19 - Alpha Blocker Meeting (F13Alpha) #3 (recap)
- 2010-02-24 - Alpha Go/No-Go Meeting (20:00 EST)
- 2010-02-25 - Yum Langpack plugin test day
- 2010-03-10 - Pre-Beta Acceptance Test Plan #1
- 2010-03-12 - Beta Blocker Meeting (F13Beta) #1 (recap)
- 2010-03-18 - Gnome Disk Utility Storage Test Day
- 2010-03-18 - Test Beta 'Test Compose' DELAYED
- 2010-03-19 - Beta Blocker Meeting (F13Beta) #2 (recap)
- 2010-03-25 - Test Beta Candidate
- 2010-03-25 - Printing Test Day
- 2010-03-26 - Beta Blocker Meeting (F13Beta) #3
- 2010-03-30 - SSSD by default Test Day
- 2010-03-31 - Beta Go/No-Go Meeting (20:00 EST)
- 2010-04-01 - ABRT Test Day
- 2010-04-08 - Virtualization Test Day
- 2010-04-13 - Test_Day:2010-04-13_Nouveau
- 2010-04-14 - Test_Day:2010-04-14_Radeon
- 2010-04-15 - Test_Day:2010-04-15_Intel
- 2010-04-16 - Final Blocker Meeting (f13blocker) #1 (recap)
- WE ARE HERE
- 2010-04-16 - Pre-RC Branched Acceptance Test Plan
- 2010-04-22 - Test_Day:2010-04-22_StorageFiltering
- 2010-04-23 - Final Blocker Meeting (f13blocker) #2
- 2010-04-29 - Test_Day:2010-04-29_Preupgrade
- 2010-04-29 - Test 'Final' Test Compose
- 2010-04-30 - Final Blocker Meeting (f13blocker) #3
- 2010-05-05 - Final Blocker Meeting (f13blocker) #4
- 2010-05-06 - Test 'Final' RC
Action items
- jlaska + fenris02 to review whether F-13-Beta is an option for boot.fedoraproject.org
- kparal will bother other QA members if they have some comments to the test plan :)
- maxamillion - send Proventester draft to test@l.fp.org for final review
- maxamillion - Request new proventester FAS group
IRC Transcript
| ========================================= | ||
| #fedora-meeting: Fedora Quality Assurance | ||
| ========================================= | ||
| Meeting started by jlaska at 15:00:05 UTC. The full logs are available | ||
| at | ||
| http://meetbot.fedoraproject.org/fedora-meeting/2010-04-19/fedora-qa.2010-04-19-15.00.log.html | ||
| . | ||
| Meeting summary | ||
| --------------- | ||
| * Waiting for participants ... (jlaska, 15:00:24) | ||
| * Previous meeting follow-up (jlaska, 15:05:39) | ||
| * Fedora 13 RC test status (jlaska, 15:07:31) | ||
| * Blocker review - Last friday we had our first F-13-RC blocker | ||
| meeting, and another is scheduled for this week (jlaska, 15:10:12) | ||
| * LINK: | ||
| http://poelstra.fedorapeople.org/schedules/f-13/f-13-quality-tasks.html | ||
| (maxamillion, 15:10:29) | ||
| * Acceptance test - This thursday a test run is scheduled for a new | ||
| post-beta anaconda build (jlaska, 15:10:46) | ||
| * 2010-04-29 - Test 'Final' Test Compose (jlaska, 15:11:19) | ||
| * 2010-05-06 - Test 'Final' RC (jlaska, 15:11:26) | ||
| * 2010-04-22 - | ||
| https://fedoraproject.org/wiki/Test_Day:2010-04-22_StorageFiltering | ||
| (jlaska, 15:12:44) | ||
| * 2010-04-29 - Preupgrade test day | ||
| (https://fedoraproject.org/wiki/Test_Day:2010-04-29_Preupgrade) | ||
| (jlaska, 15:13:00) | ||
| * F-13 QA retrospective - now accepting ideas for improvement | ||
| https://fedoraproject.org/wiki/Fedora_13_QA_Retrospective (jlaska, | ||
| 15:16:21) | ||
| * LINK: https://fedoraproject.org/wiki/XFCE_Test_Day:Tentative | ||
| (maxamillion, 15:19:30) | ||
| * Bodhi QA workflow status check-in (jlaska, 15:20:09) | ||
| * fenris02 asked how to update boot.fedoraproject.org with F-13-Beta | ||
| (jlaska, 15:21:34) | ||
| * LINK: | ||
| http://git.fedorahosted.org/git/?p=fedora-infrastructure.git;a=blob;f=bfo/pxelinux.cfg/fedora_install.conf;h=26acb46afa285f999356c912305395294240b0dd;hb=HEAD | ||
| (jlaska, 15:22:54) | ||
| * ACTION: jlaska + fenris02 to review whether F-13-Beta is an option | ||
| for boot.fedoraproject.org (jlaska, 15:23:45) | ||
| * adamw asked lmacken and mathieu for a heads up as to when the | ||
| improved feedback system will be available (jlaska, 15:30:18) | ||
| * Proventesters check-in (jlaska, 15:31:23) | ||
| * As a nice April fools joke, maxamillion sent out the proventesters | ||
| draft | ||
| (http://lists.fedoraproject.org/pipermail/test/2010-April/089847.html) | ||
| (jlaska, 15:32:00) | ||
| * Package Acceptance Test Plan check-in (jlaska, 15:36:20) | ||
| * LINK: | ||
| https://fedoraproject.org/wiki/User:Kparal/Proposal:Package_update_acceptance_test_plan | ||
| (kparal, 15:36:56) | ||
| * kparal asked for additional input on the package update acceptance | ||
| test plan (jlaska, 15:46:14) | ||
| * ACTION: kparal will bother other QA members if they have some | ||
| comments to the test plan :) (jlaska, 15:46:46) | ||
| * Proventesters check-in (jlaska, 15:48:10) | ||
| * maxamillion notes, "it looks like we're ready to move forward with | ||
| the proposal" (jlaska, 15:48:33) | ||
| * ACTION: maxamillion - send Proventester draft to test@l.fp.org for | ||
| final review (jlaska, 15:54:52) | ||
| * ACTION: maxamillion - Request new proventester FAS group (jlaska, | ||
| 15:55:25) | ||
| * AutoQA check-in (jlaska, 15:56:07) | ||
| * Test results sent to autoqa-results will include a link to the | ||
| autotest results for additional details (patches under review) | ||
| (jlaska, 15:59:31) | ||
| * Getting URLs of test results from AutoQA testruns is nearly finished | ||
| (jskladan, 15:59:41) | ||
| * LINK: | ||
| https://fedorahosted.org/pipermail/autoqa-results/2010-April/016011.html | ||
| (jlaska, 16:01:18) | ||
| * the beakerlib-based initscript test is now in production and sending | ||
| results (jlaska, 16:01:46) | ||
| * made a progress on the ResultsDB front. We have finished the db | ||
| schema <https://fedoraproject.org/wiki/AutoQA_resultsdb_schema> and | ||
| accepted a input API | ||
| <https://fedoraproject.org/wiki/AutoQA_resultsdb_API> (jlaska, | ||
| 16:03:26) | ||
| * Next steps ... prototyping the resultsdb and using an XMLRPC based | ||
| API to populate with results (jlaska, 16:06:12) | ||
| * Next steps ... Creating a front-end which will be used for | ||
| review/publish the data (jlaska, 16:06:36) | ||
| * LINK: https://fedoraproject.org/wiki/Test_Package_Sanity (kparal, | ||
| 16:08:04) | ||
| * LINK: | ||
| https://fedorahosted.org/autoqa/milestone/Package%20Sanity%20Tests | ||
| (kparal, 16:08:09) | ||
| * code for sanity tests is in AutoQA pst branch (kparal, 16:10:15) | ||
| * LINK: | ||
| http://git.fedorahosted.org/git/?p=autoqa.git;a=shortlog;h=refs/heads/pst | ||
| (jlaska, 16:10:25) | ||
| * Open discussion - <Your topic here> (jlaska, 16:18:23) | ||
| * AutoQA depcheck - we have enough info about current bodhi to write a | ||
| update watcher, but it may have some shortcomings and will soon be | ||
| obsoleted (jlaska, 16:22:42) | ||
| * AutoQA - we have a proposed storage encoding for putting test plan | ||
| metadata in the wiki, and some code to pull that data back out as | ||
| nice python dicts (jlaska, 16:24:13) | ||
| * LINK: https://fedorahosted.org/autoqa/ticket/137 has the link to the | ||
| parsing code (wwoods, 16:25:13) | ||
| Meeting ended at 16:26:06 UTC. | ||
| Action Items | ||
| ------------ | ||
| * jlaska + fenris02 to review whether F-13-Beta is an option for | ||
| boot.fedoraproject.org | ||
| * kparal will bother other QA members if they have some comments to the | ||
| test plan :) | ||
| * maxamillion - send Proventester draft to test@l.fp.org for final | ||
| review | ||
| * maxamillion - Request new proventester FAS group | ||
| Action Items, by person | ||
| ----------------------- | ||
| * fenris02 | ||
| * jlaska + fenris02 to review whether F-13-Beta is an option for | ||
| boot.fedoraproject.org | ||
| * jlaska | ||
| * jlaska + fenris02 to review whether F-13-Beta is an option for | ||
| boot.fedoraproject.org | ||
| * kparal | ||
| * kparal will bother other QA members if they have some comments to | ||
| the test plan :) | ||
| * maxamillion | ||
| * maxamillion - send Proventester draft to test@l.fp.org for final | ||
| review | ||
| * maxamillion - Request new proventester FAS group | ||
| * **UNASSIGNED** | ||
| * (none) | ||
| People Present (lines said) | ||
| --------------------------- | ||
| * jlaska (174) | ||
| * kparal (39) | ||
| * maxamillion (28) | ||
| * adamw (23) | ||
| * jskladan (19) | ||
| * wwoods (16) | ||
| * fenris02 (8) | ||
| * zodbot (4) | ||
| * Oxf13 (3) | ||
| * _lmr_ (2) | ||
Generated by MeetBot_ 0.1.4
| ||
.. _MeetBot: http://wiki.debian.org/MeetBot
|
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!