QA/Meetings/20100208

Attendees

People present (lines said)

Regrets:

• User:liam
• User:rhe
• User:wwoods

Agenda

• Proposed meeting agenda
• [FIXME meetbot summary]

Previous meeting follow-up

1. jlaska request zodbot tracking for updated F-13 QA RSS feeds (blocker bugs, common_bugs? etc...
2. jlaska to organize a gobby meeting with wwoods+kparal to begin requirements/goal definition for a results db
   • wwoods and kparal were kind enough to take this on and a meeting is scheduled for tomorrow
3. jlaska to discuss updating QA schedule with poelstra to reflect new 'release validation' focus
   • No updates yet
4. jlaska and adamw to work on drafting a 'last known good' wiki page
   • jlaska discussed expectations with jkeating, need to clarify some terminology changes, but will activate this task shortly.

Rawhide Acceptance Testing

Last week, 2010-02-04 was the third pre-Alpha rawhide acceptance test milestone. Jkeating and dlehman coordinated to do a second compose (see rel-eng ticket#3337). Install images were built and posted on alt.fedoraproject.org. Since AutoQA doesn't yet monitor this location for new install images, tests were initiated manually.

Test Summary:

• Automated rats_install FAIL (note bug#559290 causing LVM to fail)
• Results available at Test_Results:Fedora_13_Rawhide_Acceptance_Test_3.

Next Steps:

• Fix AutoQA post-tree-compose hook to monitor for RAT droppings (see ticket#115)
• Discuss proposed rats_install changes with wwoods and draft a patch

Questions/Concerns:

• Jkeating asked what does 'last known good' (LKG) mean? - Does it mean that the install images and package source are good? Jlaska felt that for QA, it means here's we tested a particular install image and package set, and it was good. Adamw offered to help document this on the wiki, but asked for clarification/guidance once the mechanics have settled down.
• Jlaska asked how do we know we're done with the 'last known good' (LKG) project?, Jkeating offered ...

   <Oxf13> in my head there is a simple webpage that is maintained by QA
   <Oxf13> this webpage describes Last Known Good and the fact that rawhide no
   longer has images of it's own
   <Oxf13> onthis page would be links to the install image files, and to the tree
   of packages it was found to be good with
   <Oxf13> with instructions on how to combine the two into an install
   <Oxf13> and finally notes that without picking a specific repo of packages, the
   images will attempt to install the latest repo of packages on the mirror system
   <Oxf13> which has not been validated, and may not work

AutoQA project update

Deps/conflicts prevention

• Milestone - https://fedorahosted.org/autoqa/milestone/autoqa%20depcheck
• Owner - User:wwoods

Last week

• wwoods working with skvidal and other rpm hackers to try and solve the depcheck problem
• wwoods looking for help in doing the post-bodhi-update hook
• kparal has code for generating fake RPMs for testing in git as rpmguard_test.py
• Friday afternoon I got a working yum-based prototype of the depcheck code (see http://git.fedorahosted.org/git/?p=autoqa.git;a=blob;f=tests/depcheck/depcheck)

This week

• Build a testsuite to validate depchecks functionality (possibly using rpmfluff)

rpmguard and autoqa results collection

• Milestone - https://fedorahosted.org/autoqa/milestone/Package%20update%20tests
• Owner - User:kparal

Last week

• Address ticket#113 - skip checks against same package NVR
• Address ticket#114 - locate latest previous package from stable and updates repos. Makes it easier to run the test manually at some future date.

This week

• Initial brainstorming on results db ideas

install automation

• Milestone - https://fedorahosted.org/autoqa/milestone/Automate%20installation%20test%20plan
• Owner - User:lili, User:rhe

Last week

• Liam announced a DVD install test case to autoqa-devel list (see https://fedorahosted.org/pipermail/autoqa-devel/2010-January/000178.html)!

This week

• Continue discussion around dvd-install test case and identify how to proceed

packaging/deployment

• Milestone - https://fedorahosted.org/autoqa/milestone/Packaging%20and%20Review
• Owner - User:jlaska

Last week

• Process akurtakov's feedback and remove all uncertain JAR files from the list (see User:Jlaska/gwt#Status_uncertain).

This week

• Seek guidance from upstream GWT for ...
  1. Cases where multiple versions of a JAR are bundled
  2. Need for remaining bundled JARs? (see User:Jlaska/gwt#Status_uncertain)
  3. Begin packaging JPackage JAR files for Fedora

Upcoming QA events

• 2010-01-21 - Pre-Alpha Rawhide Acceptance Test Plan #1
• 2010-01-28 - Pre-Alpha Rawhide Acceptance Test Plan #2
• 2010-02-04 - Pre-Alpha Rawhide Acceptance Test Plan #3
• 2010-02-04 - NFSv4 Test Day
• 2010-02-05 - Alpha Blocker Meeting (F13Alpha) #1 (recap)
• WE ARE HERE
• 2010-02-11 - Test Alpha 'Test Compose' (boot media testing)
• 2010-02-12 - Alpha Blocker Meeting (F13Alpha) #2