From Fedora Project Wiki

< QA‎ | Meetings

(Initial draft)
 
(Updated minutes)
Line 2: Line 2:


People present (lines said)
People present (lines said)
* jlaska (154)
* adamw (57)
* Viking-Ice (19)
* maxamillion (17)
* wwoods (12)
* kparal (8)
* nirik (4)
* zodbot (3)
* buggbot (1)


Regrets:
Regrets:
Line 34: Line 44:


= Action items =
= Action items =
* Viking-Ice investigating adding an LXDE test day to the F-13 test day schedule
* maxamillion investigating scheduling a XFCE test day to F-13 test day schedule
* adamw and rhe to discuss ways to add install testing as a QA activity
* jlaska will reach out to mclasen for thoughts on F-13 fit'n'finish test days
* jlaska to reach out ot fedora-{test,devel}-list for trading reviews
* jlaska to reach out to beland for guidance/ideas on how to document the process (or point to existing documentation) for how bugs are noted (common_bugs, release notes, install guide etc...) How to determine which bugs land in which place


= IRC transcript =
= IRC transcript =
{|
|- id="t16:01:14"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #startmeeting Fedora QA Meeting
|| [[#t16:01:14|16:01]]
|- id="t16:01:14"
! style="background-color: #42427e" | zodbot
| style="color: #42427e" | Meeting started Mon Jan  4 16:01:14 2010 UTC.  The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot.
|| [[#t16:01:14|16:01]]
|- id="t16:01:14"
! style="background-color: #42427e" | zodbot
| style="color: #42427e" | Useful Commands: #action #agreed #halp #info #idea #link #topic.
|| [[#t16:01:14|16:01]]
|- id="t16:01:21"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #meetingname qa
|| [[#t16:01:21|16:01]]
|- id="t16:01:21"
! style="background-color: #42427e" | zodbot
| style="color: #42427e" | The meeting name has been set to 'qa'
|| [[#t16:01:21|16:01]]
|- id="t16:01:34"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic gathering
|| [[#t16:01:34|16:01]]
|- id="t16:02:03"
! style="background-color: #818144" | adamw
| style="color: #818144" | hellllo
|| [[#t16:02:03|16:02]]
|- id="t16:02:04"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Howdy folks ... let's do a show of hands
|| [[#t16:02:04|16:02]]
|- id="t16:02:30"
| colspan="2" | * wwoods shows off his hands
|| [[#t16:02:30|16:02]]
|- id="t16:02:37"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | ooh, look at those hands
|| [[#t16:02:37|16:02]]
|- id="t16:02:53"
! style="background-color: #854685" | wwoods
| style="color: #854685" | theyr'e the new '10 model
|| [[#t16:02:53|16:02]]
|- id="t16:02:53"
| colspan="2" | * kparal waves too
|| [[#t16:02:53|16:02]]
|- id="t16:02:55"
! style="background-color: #818144" | adamw
| style="color: #818144" | who'd you cut them off? and where'd you get the jars?
|| [[#t16:02:55|16:02]]
|- id="t16:02:57"
| colspan="2" | * Viking-Ice raises his hand for a high five on the new year..
|| [[#t16:02:57|16:02]]
|- id="t16:03:26"
! style="background-color: #854685" | wwoods
| style="color: #854685" | Viking-Ice: o/ \o
|| [[#t16:03:26|16:03]]
|- id="t16:03:35"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | down low
|| [[#t16:03:35|16:03]]
|- id="t16:03:47"
! style="background-color: #818144" | adamw
| style="color: #818144" | wwoods can give you a high twenty
|| [[#t16:03:47|16:03]]
|- id="t16:04:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | alright ... let's get things started
|| [[#t16:04:01|16:04]]
|- id="t16:04:19"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | we've got a light agenda today ... but always room for 'open discussion'
|| [[#t16:04:19|16:04]]
|- id="t16:04:28"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Previous meeting follow-up
|| [[#t16:04:28|16:04]]
|- id="t16:04:46"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay ... trying to figure out which meeting was the previous
|| [[#t16:04:46|16:04]]
|- id="t16:05:04"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | the last set of tasks I'm tracking are listed at https://fedoraproject.org/wiki/QA/Meetings/20100104#Previous_meeting_follow-up
|| [[#t16:05:04|16:05]]
|- id="t16:05:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info jlaska to post recommendations on F-12 QA retrospective
|| [[#t16:05:20|16:05]]
|- id="t16:05:36"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | these are posted and available at https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Recommendations
|| [[#t16:05:36|16:05]]
|- id="t16:05:54"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I've left most of the agenda for walking through this
|| [[#t16:05:54|16:05]]
|- id="t16:06:08"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | next I've got ...
|| [[#t16:06:08|16:06]]
|- id="t16:06:26"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info adamw to escalate security policy issue to fesco
|| [[#t16:06:26|16:06]]
|- id="t16:07:03"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I don't have any updates on that one ... did that already happen?
|| [[#t16:07:03|16:07]]
|- id="t16:07:12"
! style="background-color: #818144" | adamw
| style="color: #818144" | err. i think i filed a ticket. just a sec
|| [[#t16:07:12|16:07]]
|- id="t16:07:45"
! style="background-color: #818144" | adamw
| style="color: #818144" | yeah, I did
|| [[#t16:07:45|16:07]]
|- id="t16:07:47"
! style="background-color: #818144" | adamw
| style="color: #818144" | https://fedorahosted.org/fesco/ticket/297
|| [[#t16:07:47|16:07]]
|- id="t16:08:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | ah great
|| [[#t16:08:01|16:08]]
|- id="t16:08:06"
! style="background-color: #818144" | adamw
| style="color: #818144" | no reply yet
|| [[#t16:08:06|16:08]]
|- id="t16:08:12"
| colspan="2" | * jlaska lost the linky
|| [[#t16:08:12|16:08]]
|- id="t16:08:24"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so that'll come up for discussion at the next FESCO meeting right?
|| [[#t16:08:24|16:08]]
|- id="t16:08:53"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Next up ...
|| [[#t16:08:53|16:08]]
|- id="t16:08:57"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info jlaska to set up a meeting to co-ordinate test plan changes for F13
|| [[#t16:08:57|16:08]]
|- id="t16:09:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | We had a quick sprint the week prior to Christmas with adamw, lili, rhe and myself walking through the list of F-13 test plan tickets
|| [[#t16:09:30|16:09]]
|- id="t16:10:09"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | still lots of kinks to iron out in the sprint process, and there are still a few inprogress tickets
|| [[#t16:10:09|16:10]]
|- id="t16:10:15"
| colspan="2" | * jlaska searches for ticket query
|| [[#t16:10:15|16:10]]
|- id="t16:11:22"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | https://fedorahosted.org/fedora-qa/query?status=new&amp;status=assigned&amp;status=reopened&amp;component=Test+Review&amp;milestone=Fedora+13&amp;order=priority
|| [[#t16:11:22|16:11]]
|- id="t16:11:44"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I'll circle back and bump the status on a few of those later today
|| [[#t16:11:44|16:11]]
|- id="t16:11:55"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | last item ...
|| [[#t16:11:55|16:11]]
|- id="t16:11:58"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info adamw and jlaska to look at setting up f13 test day process
|| [[#t16:11:58|16:11]]
|- id="t16:12:14"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | No updates from me on this ... I'd like to chat w/ adamw this week to iron out an approach
|| [[#t16:12:14|16:12]]
|- id="t16:12:39"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | is there something that is going to be greatly different from the last test day process(es)?
|| [[#t16:12:39|16:12]]
|- id="t16:12:48"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | we've got initial ideas posted to the wiki already ... https://fedoraproject.org/wiki/Talk:QA/Fedora_13_test_days
|| [[#t16:12:48|16:12]]
|- id="t16:13:05"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: I don't expect so ... just need to get on top of it and actively work the schedule
|| [[#t16:13:05|16:13]]
|- id="t16:13:46"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay, anything not mentioned?
|| [[#t16:13:46|16:13]]
|- id="t16:13:49"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | ah, nice
|| [[#t16:13:49|16:13]]
|- id="t16:13:56"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | I'll be sure to read that later
|| [[#t16:13:56|16:13]]
|- id="t16:14:04"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | if not ... we'll jump into the F-13 QA recommendations
|| [[#t16:14:04|16:14]]
|- id="t16:14:19"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: cool, and of course, test day topic suggestions encouraged too!
|| [[#t16:14:19|16:14]]
|- id="t16:14:29"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic F-13 QA Recommendations
|| [[#t16:14:29|16:14]]
|- id="t16:14:57"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | So ... I've taking all the QA retrospective feedback and tried to organize things into several groups
|| [[#t16:14:57|16:14]]
|- id="t16:15:04"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | jlaska: I'll be working with kevin and christoph on the xfce spin test day plans and try to add suggestions if I find any :)
|| [[#t16:15:04|16:15]]
|- id="t16:15:32"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: awesome, that's just what I had in mind.  Any additional spin test days would be fun (much like the sugar event)
|| [[#t16:15:32|16:15]]
|- id="t16:15:39"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | I was thinking about going knee deep in LXDE so I should be able to write something..
|| [[#t16:15:39|16:15]]
|- id="t16:16:19"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | Viking-Ice: be sure to touch base with cwickert, i'm sure he'd welcome the interest in LXDE
|| [[#t16:16:19|16:16]]
|- id="t16:16:24"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so I've organized the feedback into the following themes: process, planning, communication and automation
|| [[#t16:16:24|16:16]]
|- id="t16:16:47"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | these aren't hard themes, just what bubbled up from how I read the data
|| [[#t16:16:47|16:16]]
|- id="t16:17:05"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so there is overlap between these themes .. but in general, I was happy with the grouping
|| [[#t16:17:05|16:17]]
|- id="t16:17:06"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | maxamillion: I was planning to hear from him..
|| [[#t16:17:06|16:17]]
|- id="t16:17:16"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | Viking-Ice: cool cool :)
|| [[#t16:17:16|16:17]]
|- id="t16:17:35"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: Viking-Ice should I add an action item for next week on this?  or too soon?
|| [[#t16:17:35|16:17]]
|- id="t16:17:49"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | ^--&gt; re: LXDE and XFCE spin test days?
|| [[#t16:17:49|16:17]]
|- id="t16:18:23"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | you can add action item for me
|| [[#t16:18:23|16:18]]
|- id="t16:18:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay
|| [[#t16:18:30|16:18]]
|- id="t16:18:37"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | we could do next week, that would give me a bit of motivation to get on the ball about it
|| [[#t16:18:37|16:18]]
|- id="t16:18:41"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | errr I*
|| [[#t16:18:41|16:18]]
|- id="t16:18:51"
| colspan="2" | * Viking-Ice works best under pressure..
|| [[#t16:18:51|16:18]]
|- id="t16:18:56"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action Viking-Ice investigating adding an LXDE test day to the F-13 test day schedule
|| [[#t16:18:56|16:18]]
|- id="t16:19:29"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action maxamillion investigating scheduling a XFCE test day to F-13 test day schedule
|| [[#t16:19:29|16:19]]
|- id="t16:20:15"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | w00t! my first action item in the QA world :P
|| [[#t16:20:15|16:20]]
|- id="t16:20:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: heh, you've arrived :D
|| [[#t16:20:25|16:20]]
|- id="t16:20:42"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so have folks had a chance to look through the recommendations?
|| [[#t16:20:42|16:20]]
|- id="t16:20:49"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Recommendations
|| [[#t16:20:49|16:20]]
|- id="t16:21:06"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | there shouldn't be surprises there ... I've basically reorganized the feedback provided
|| [[#t16:21:06|16:21]]
|- id="t16:21:36"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | what I'd like to do is walk through the list and see if we can identify owners for some of the tasks
|| [[#t16:21:36|16:21]]
|- id="t16:21:44"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | jlaska: do you want to #link that so its in the minutes? (that might not even be the right tag, but you get the idea) :)
|| [[#t16:21:44|16:21]]
|- id="t16:21:55"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: sure ...
|| [[#t16:21:55|16:21]]
|- id="t16:22:05"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Recommendations
|| [[#t16:22:05|16:22]]
|- id="t16:22:57"
! style="background-color: #818144" | adamw
| style="color: #818144" | just refreshing my memory
|| [[#t16:22:57|16:22]]
|- id="t16:23:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | many of the listed recommendations are things several of you are already on top of
|| [[#t16:23:01|16:23]]
|- id="t16:23:35"
! style="background-color: #818144" | adamw
| style="color: #818144" | i could take "Promote install testing as a QA activity"
|| [[#t16:23:35|16:23]]
|- id="t16:24:18"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: thanks, Hurry has some ideas on this already ... would you two like to sync up?
|| [[#t16:24:18|16:24]]
|- id="t16:24:41"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | perhaps her experience on the install side iwth your wiki mastery can come up with some good ideas
|| [[#t16:24:41|16:24]]
|- id="t16:24:59"
! style="background-color: #818144" | adamw
| style="color: #818144" | also most of the 'communication' stuff
|| [[#t16:24:59|16:24]]
|- id="t16:25:10"
! style="background-color: #818144" | adamw
| style="color: #818144" | well yeah i was just meaning i could do the wiki bits
|| [[#t16:25:10|16:25]]
|- id="t16:25:21"
! style="background-color: #818144" | adamw
| style="color: #818144" | stick me in a #action
|| [[#t16:25:21|16:25]]
|- id="t16:25:25"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | I need a little explanation with this "Determine whether guides can be offered by Fedora QA as a result of a test day/feature process"
|| [[#t16:25:25|16:25]]
|- id="t16:25:47"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action adamw and rhe to discuss ways to add install testing as a QA activity
|| [[#t16:25:47|16:25]]
|- id="t16:26:12"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: kparal had some social networking suggestions already, perhaps we can divide and conquer there?
|| [[#t16:26:12|16:26]]
|- id="t16:26:29"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: my thinking there was to follow your lead for dracut
|| [[#t16:26:29|16:26]]
|- id="t16:26:37"
! style="background-color: #4b904b" | kparal
| style="color: #4b904b" | not really mine suggestions, but I can help
|| [[#t16:26:37|16:26]]
|- id="t16:26:53"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | kparal: oh right ...these were from the lunch'n'learn
|| [[#t16:26:53|16:26]]
|- id="t16:27:00"
! style="background-color: #4b904b" | kparal
| style="color: #4b904b" | correct
|| [[#t16:27:00|16:27]]
|- id="t16:27:02"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | Advertice on the Fedora Project network on FB
|| [[#t16:27:02|16:27]]
|- id="t16:27:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: basically, that dracut debug page rocks ... I'd like to see we can follow that model again for maybe a few features?
|| [[#t16:27:20|16:27]]
|- id="t16:27:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | what do you think?
|| [[#t16:27:23|16:27]]
|- id="t16:27:43"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | sounds raz..
|| [[#t16:27:43|16:27]]
|- id="t16:28:19"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | I'll run through the feature stuff and see what I can write..
|| [[#t16:28:19|16:28]]
|- id="t16:28:44"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: sweet, I think that would be tremendously helpful.  I just don't know a good way to target specfiic features
|| [[#t16:28:44|16:28]]
|- id="t16:28:58"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | dracut was a good choice since it was something *everyone* would need
|| [[#t16:28:58|16:28]]
|- id="t16:29:09"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | perhaps python3 might be similar in that regard?  or others
|| [[#t16:29:09|16:29]]
|- id="t16:30:22"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedoraproject.org/wiki/Releases/13/FeatureList
|| [[#t16:30:22|16:30]]
|- id="t16:30:53"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic F-13 QA Recommendations - test planning
|| [[#t16:30:53|16:30]]
|- id="t16:31:02"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | on the test planning front ... much of this is already underway
|| [[#t16:31:02|16:31]]
|- id="t16:31:32"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Maintenance of the Fedora Install Test Plan - Liam and Hurry are doing a lot of heavy lifting here
|| [[#t16:31:32|16:31]]
|- id="t16:31:55"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Draft a more formal, but basic and lightweight, security checklist/test plan - discussed earlier, adamw has a fesco ticket filed ... stay tuned
|| [[#t16:31:55|16:31]]
|- id="t16:32:14"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Draft a test plan to cover the desktop verification from Fedora_Release_Criteria
|| [[#t16:32:14|16:32]]
|- id="t16:32:19"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedoraproject.org/wiki/Fedora_Release_Criteria
|| [[#t16:32:19|16:32]]
|- id="t16:32:26"
! style="background-color: #4b904b" | kparal
| style="color: #4b904b" | I noticed adamw is creating test plan for the desktop stuff: https://fedoraproject.org/wiki/Category:Desktop_Acceptance_Test_Cases
|| [[#t16:32:26|16:32]]
|- id="t16:32:37"
! style="background-color: #818144" | adamw
| style="color: #818144" | yeah, i'm in teh middle of that
|| [[#t16:32:37|16:32]]
|- id="t16:32:43"
! style="background-color: #818144" | adamw
| style="color: #818144" | got about halfway through before the xmas break
|| [[#t16:32:43|16:32]]
|- id="t16:32:46"
! style="background-color: #818144" | adamw
| style="color: #818144" | will be back on it this week
|| [[#t16:32:46|16:32]]
|- id="t16:32:47"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | kparal: perfect, thanks for the link
|| [[#t16:32:47|16:32]]
|- id="t16:33:00"
! style="background-color: #4b904b" | kparal
| style="color: #4b904b" | I will gladly help with that if time permits
|| [[#t16:33:00|16:33]]
|- id="t16:33:15"
! style="background-color: #818144" | adamw
| style="color: #818144" | sure, if anyone wants to chip in tests that'd be great
|| [[#t16:33:15|16:33]]
|- id="t16:33:15"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | I think we need to get in touch with the X team to come up with an formal Xorg test plan ( not just x11-drv-* )
|| [[#t16:33:15|16:33]]
|- id="t16:33:26"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: good segway ... that was next
|| [[#t16:33:26|16:33]]
|- id="t16:33:30"
! style="background-color: #818144" | adamw
| style="color: #818144" | well we talked about that quite a lot at the sprint
|| [[#t16:33:30|16:33]]
|- id="t16:33:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info We have no formal Xorg-x11-drv test plan ... either create one, or develop proposal for gathering the same feedback through other means (smolt, bugzilla)
|| [[#t16:33:31|16:33]]
|- id="t16:33:50"
! style="background-color: #818144" | adamw
| style="color: #818144" | i actually don't think a test plan for X would achieve much
|| [[#t16:33:50|16:33]]
|- id="t16:33:58"
! style="background-color: #818144" | adamw
| style="color: #818144" | we started doing a test matrix then realized it was pretty pointless
|| [[#t16:33:58|16:33]]
|- id="t16:34:15"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: can you talk more about how we came to that conclusion?
|| [[#t16:34:15|16:34]]
|- id="t16:34:18"
! style="background-color: #818144" | adamw
| style="color: #818144" | the tricky thing with X is that the main problem with it is that we're dealing with seventy zillion different bits of hardware
|| [[#t16:34:18|16:34]]
|- id="t16:34:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | yeah that ---^ :)
|| [[#t16:34:31|16:34]]
|- id="t16:34:33"
! style="background-color: #818144" | adamw
| style="color: #818144" | and the level of functionality we currently care about is pretty basic, this isn't really deep level stuff
|| [[#t16:34:33|16:34]]
|- id="t16:34:52"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | I think there could be a matrix of hardware and "Works for Me" and maybe some break down of how much works (KMS, direct rendering, etc)
|| [[#t16:34:52|16:34]]
|- id="t16:35:02"
! style="background-color: #818144" | adamw
| style="color: #818144" | the types of problems we get with X are not 'this one out of the millions of really complex levels of functionality suddenly regressed' but 'o shit this card doesn't work any more'
|| [[#t16:35:02|16:35]]
|- id="t16:35:18"
! style="background-color: #818144" | adamw
| style="color: #818144" | maxamillion: that would rapidly get HORRIBLY unsustainable
|| [[#t16:35:18|16:35]]
|- id="t16:35:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: if someone wanted to look into how to pull this out of smolt and present the information ... that would be a fun project
|| [[#t16:35:20|16:35]]
|- id="t16:35:27"
! style="background-color: #818144" | adamw
| style="color: #818144" | i really can't emphasize the amount of hardware we're talking about here enough
|| [[#t16:35:27|16:35]]
|- id="t16:35:35"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | adamw: for a test day?
|| [[#t16:35:35|16:35]]
|- id="t16:35:38"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | what about input ( keyboards usb etc ) and for example multitouch ?
|| [[#t16:35:38|16:35]]
|- id="t16:35:39"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | or you mean long term
|| [[#t16:35:39|16:35]]
|- id="t16:35:40"
! style="background-color: #818144" | adamw
| style="color: #818144" | we already do test days
|| [[#t16:35:40|16:35]]
|- id="t16:35:41"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | ?
|| [[#t16:35:41|16:35]]
|- id="t16:35:47"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | oh ok, i misunderstood
|| [[#t16:35:47|16:35]]
|- id="t16:35:55"
! style="background-color: #818144" | adamw
| style="color: #818144" | we're talking about some kind of test plan
|| [[#t16:35:55|16:35]]
|- id="t16:36:03"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | sorry, I'm in a meeting at $dayjob and trying to keep up with this one ... don't mind me :P
|| [[#t16:36:03|16:36]]
|- id="t16:36:14"
! style="background-color: #818144" | adamw
| style="color: #818144" | i just don't think that's an approach that fixes the X situation; it's not the paradigm that addresses the kinds of problems we actually get with X
|| [[#t16:36:14|16:36]]
|- id="t16:36:29"
! style="background-color: #488888" | maxamillion
| style="color: #488888" | adamw: yeah, I agree
|| [[#t16:36:29|16:36]]
|- id="t16:36:31"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | maxamillion: no it's a good suggestion ... it's just trying to figure out how to sustainably execute the plan and track the data
|| [[#t16:36:31|16:36]]
|- id="t16:36:55"
! style="background-color: #818144" | adamw
| style="color: #818144" | Viking-Ice: um. in theory an input matrix is a useful idea, but in practice it kinda depends how much we care about anything besides basic mouse+keyboard stuff
|| [[#t16:36:55|16:36]]
|- id="t16:37:02"
! style="background-color: #818144" | adamw
| style="color: #818144" | er, s/matrix/test plan/
|| [[#t16:37:02|16:37]]
|- id="t16:37:13"
! style="background-color: #818144" | adamw
| style="color: #818144" | multitouch is way too basic at this point to worry about
|| [[#t16:37:13|16:37]]
|- id="t16:37:20"
! style="background-color: #818144" | adamw
| style="color: #818144" | you can't really _use_ it in any meaningful way yet
|| [[#t16:37:20|16:37]]
|- id="t16:37:58"
! style="background-color: #818144" | adamw
| style="color: #818144" | jlaska still reckons some kind of test plan for X is a good idea, but i still don't quite understand exactly what we can achieve with one that we're not achieving already; this is where we left it in the sprint :)
|| [[#t16:37:58|16:37]]
|- id="t16:37:58"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | one way we can use the existing test cases is much how they've been used so far
|| [[#t16:37:58|16:37]]
|- id="t16:38:51"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | for test days and for use to help isolate the true failure of reported bugs
|| [[#t16:38:51|16:38]]
|- id="t16:39:05"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | adamw: Ok Talking about meaningful did we receive any feed back from nirik and others on the front ( forums #fedora etc ) about what they get bombarded with ( perhaps something we should track and target for test days )
|| [[#t16:39:05|16:39]]
|- id="t16:39:18"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: good suggestion
|| [[#t16:39:18|16:39]]
|- id="t16:39:47"
| colspan="2" | * nirik looks up.
|| [[#t16:39:47|16:39]]
|- id="t16:39:56"
! style="background-color: #818144" | adamw
| style="color: #818144" | well, i'm mostly on teh front for X stuff, and yeah, we do co-ordinate a bit on that
|| [[#t16:39:56|16:39]]
|- id="t16:40:00"
! style="background-color: #4d4d93" | nirik
| style="color: #4d4d93" | you mean specific stuff? or in general areas we see a lot of stuff?
|| [[#t16:40:00|16:40]]
|- id="t16:40:21"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | nirik: other soft spots from the F-12 release that could modify the QA plan for F-13
|| [[#t16:40:21|16:40]]
|- id="t16:40:29"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | all proprietary aside the issues most end users are faced with
|| [[#t16:40:29|16:40]]
|- id="t16:40:34"
! style="background-color: #818144" | adamw
| style="color: #818144" | i don't think we can add much to our process based on that feedback. i'd say broadly what you get splits into two camps: 'HELP MY X/COMPIZ DOESN'T WORK' and 'HELP MY PROPRIETARY DRIVER DOESN'T WORK'
|| [[#t16:40:34|16:40]]
|- id="t16:40:40"
! style="background-color: #818144" | adamw
| style="color: #818144" | second is out of our scope
|| [[#t16:40:40|16:40]]
|- id="t16:40:43"
! style="background-color: #818144" | adamw
| style="color: #818144" | first is already covered
|| [[#t16:40:43|16:40]]
|- id="t16:40:43"
| colspan="2" | * nirik nods.
|| [[#t16:40:43|16:40]]
|- id="t16:40:48"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | true
|| [[#t16:40:48|16:40]]
|- id="t16:41:16"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay ... last I have on the planning side is Test Days
|| [[#t16:41:16|16:41]]
|- id="t16:41:27"
! style="background-color: #818144" | adamw
| style="color: #818144" | as i said, X is fundamentally a shallow area: the issues are due to hardware variety (and the developers rewriting everything every three months). there just isn't a complex tangle of functionality to test
|| [[#t16:41:27|16:41]]
|- id="t16:42:13"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: if we had a pull of every hardware adapter available ... would there be some type of feedback to provide to X maintainers that would be valuable?
|| [[#t16:42:13|16:42]]
|- id="t16:42:51"
! style="background-color: #4d4d93" | nirik
| style="color: #4d4d93" | having the list of workarounds especially for install has been great on the common bugs list.
|| [[#t16:42:51|16:42]]
|- id="t16:42:55"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | oh god ... s/pull/pool/
|| [[#t16:42:55|16:42]]
|- id="t16:43:00"
! style="background-color: #818144" | adamw
| style="color: #818144" | well, yeah. if we had a Big Test Lab with every graphics adapter in the world in it, sure. what they'd be interested in is knowing with every day's rawhide which systems basically worked. for bonus points, which could do enough 3D to run compiz.
|| [[#t16:43:00|16:43]]
|- id="t16:43:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | heh
|| [[#t16:43:10|16:43]]
|- id="t16:43:23"
! style="background-color: #818144" | adamw
| style="color: #818144" | i mean, that's really it. like i keep saying, it's not complicated =)
|| [[#t16:43:23|16:43]]
|- id="t16:43:26"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: so instead, we have a highly distributed test lab
|| [[#t16:43:26|16:43]]
|- id="t16:43:40"
! style="background-color: #818144" | adamw
| style="color: #818144" | there was that thread about 'stop working on rawhide and work on f12' or whatever on devel-list
|| [[#t16:43:40|16:43]]
|- id="t16:43:44"
! style="background-color: #854685" | wwoods
| style="color: #854685" | (if you consider the set of Interested Fedora Users as a distributed test lab..)
|| [[#t16:43:44|16:43]]
|- id="t16:44:00"
! style="background-color: #818144" | adamw
| style="color: #818144" | dave airlie (or ajax, I forget) posted the X team's List Of Things We Really Care About to that thread, which is basically what I just said
|| [[#t16:44:00|16:44]]
|- id="t16:44:02"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | wwoods: true true
|| [[#t16:44:02|16:44]]
|- id="t16:44:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: gotcha
|| [[#t16:44:10|16:44]]
|- id="t16:44:21"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | alright ... so last I had on the planning topic was test days
|| [[#t16:44:21|16:44]]
|- id="t16:44:37"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | anyone know if they are plans to revisit the 'fit and finish' events?
|| [[#t16:44:37|16:44]]
|- id="t16:44:41"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | adamw:  Big Test Lab the world not enough ;)
|| [[#t16:44:41|16:44]]
|- id="t16:44:43"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | if not, I can follow-up w/ mclasen
|| [[#t16:44:43|16:44]]
|- id="t16:44:55"
! style="background-color: #818144" | adamw
| style="color: #818144" | sure. how i look at that is that the blocking points in that way of looking at things all involve making the lab work efficiently. the test plan is not part of that. the test plan defines _what to test_, which as I keep saying is really simple and everyone knows it already
|| [[#t16:44:55|16:44]]
|- id="t16:45:38"
! style="background-color: #818144" | adamw
| style="color: #818144" | all the problems with X testing, if we look at the 'the world is a big test lab' theory, lie in actually co-ordinating the distributed systems and people who make up the 'lab' to do testing and provide useful info. which a test plan can't really help with, i don' think. but hey. sorry, jlaska wants to move on :)
|| [[#t16:45:38|16:45]]
|- id="t16:46:05"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw, no thanks ... you explained it better than I could have hoped to
|| [[#t16:46:05|16:46]]
|- id="t16:46:57"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | Let's move along..
|| [[#t16:46:57|16:46]]
|- id="t16:47:03"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action jlaska will reach out to mclasen for thoughts on F-13 fit'n'finish test days
|| [[#t16:47:03|16:47]]
|- id="t16:47:14"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay ... any other suggestions on the test planning side for F-13?
|| [[#t16:47:14|16:47]]
|- id="t16:47:33"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | for reference ... https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Test_Planning_3
|| [[#t16:47:33|16:47]]
|- id="t16:48:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | alright ... the next group is where wwoods and kparal rock
|| [[#t16:48:23|16:48]]
|- id="t16:48:32"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic F-13 QA Recommendations - test automation
|| [[#t16:48:32|16:48]]
|- id="t16:48:43"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Test_Automation
|| [[#t16:48:43|16:48]]
|- id="t16:48:53"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | The first obvious one is ...
|| [[#t16:48:53|16:48]]
|- id="t16:49:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Deploy AutoQA 'is rawhide broken?' front-end into fedora infrastructure
|| [[#t16:49:01|16:49]]
|- id="t16:49:12"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | this is inprogress ... and going through package review at the moment
|| [[#t16:49:12|16:49]]
|- id="t16:49:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action jlaska to reach out ot fedora-{test,devel}-list for trading reviews
|| [[#t16:49:25|16:49]]
|- id="t16:49:36"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Deploy build-time sanity checking mechanism for package maintainers (rpmguard, rpmlint etc...)
|| [[#t16:49:36|16:49]]
|- id="t16:49:52"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Kamil and Will are knee deep in this now
|| [[#t16:49:52|16:49]]
|- id="t16:50:05"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | with both rpmlint and rpmguard working into the system
|| [[#t16:50:05|16:50]]
|- id="t16:50:06"
! style="background-color: #4b904b" | kparal
| style="color: #4b904b" | and will be deeper :)
|| [[#t16:50:06|16:50]]
|- id="t16:50:11"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | hehe
|| [[#t16:50:11|16:50]]
|- id="t16:50:37"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | The last item I have here is
|| [[#t16:50:37|16:50]]
|- id="t16:50:40"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #ifo Develop proof-of-concept for automating install test matrix
|| [[#t16:50:40|16:50]]
|- id="t16:50:44"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Develop proof-of-concept for automating install test matrix
|| [[#t16:50:44|16:50]]
|- id="t16:50:48"
! style="background-color: #854685" | wwoods
| style="color: #854685" | I'm pretty sure rpmguard will obsolete rpmlint eventually
|| [[#t16:50:48|16:50]]
|- id="t16:51:14"
! style="background-color: #4b904b" | kparal
| style="color: #4b904b" | I don't think so, they have different goal
|| [[#t16:51:14|16:51]]
|- id="t16:51:25"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Liam and Hurry are working towards a automated DVD install test at the moment ... and then likely will need wwoods expertise for integrating the tests into AutoQA
|| [[#t16:51:25|16:51]]
|- id="t16:51:26"
! style="background-color: #854685" | wwoods
| style="color: #854685" | kparal: hm, good point
|| [[#t16:51:26|16:51]]
|- id="t16:51:42"
! style="background-color: #854685" | wwoods
| style="color: #854685" | jlaska: yeah, I think this will probably be my first big goal for the new year?
|| [[#t16:51:42|16:51]]
|- id="t16:52:07"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | wwoods: cool, this would be huge to see traction on before F-13 kicks into high gear
|| [[#t16:52:07|16:52]]
|- id="t16:52:33"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Liam was looking into playing with install.py over the break and expanding it to do a basic DVD install ... I'll be checking in to see how he's making out soon
|| [[#t16:52:33|16:52]]
|- id="t16:52:47"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | anything else under automation that wasn't covered ... that needs to be on the radar?
|| [[#t16:52:47|16:52]]
|- id="t16:52:54"
! style="background-color: #854685" | wwoods
| style="color: #854685" | yeah, IIRC it involves designing a test that takes as input:
|| [[#t16:52:54|16:52]]
|- id="t16:53:02"
! style="background-color: #854685" | wwoods
| style="color: #854685" | 1) a description of the test system hardware (disks, disk sizes),
|| [[#t16:53:02|16:53]]
|- id="t16:53:04"
! style="background-color: #854685" | wwoods
| style="color: #854685" | 2) a kickstart (which describes partitioning etc),
|| [[#t16:53:04|16:53]]
|- id="t16:53:09"
! style="background-color: #854685" | wwoods
| style="color: #854685" | 3) an installable tree/image
|| [[#t16:53:09|16:53]]
|- id="t16:53:43"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | yeah, I should have cc'd you on the mail I sent him
|| [[#t16:53:43|16:53]]
|- id="t16:53:49"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | basically the same list of inputs
|| [[#t16:53:49|16:53]]
|- id="t16:53:51"
! style="background-color: #854685" | wwoods
| style="color: #854685" | pretty sure a test that would do that would cover the entire test matrix, but we'll see
|| [[#t16:53:51|16:53]]
|- id="t16:54:57"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay ... we touched on each of the other sections already but here they are for the logs
|| [[#t16:54:57|16:54]]
|- id="t16:55:11"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic F-13 QA Recommendations - process
|| [[#t16:55:11|16:55]]
|- id="t16:55:16"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Process_4
|| [[#t16:55:16|16:55]]
|- id="t16:55:19"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | One thing that came to my mind when I hit bug 549944 is this something we can automate an test for ( looks like version mismatch )
|| [[#t16:55:19|16:55]]
|- id="t16:55:20"
! style="background-color: #97974f" | buggbot
| style="color: #97974f" | Bug https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=549944 medium, low, ---, jskala, NEW, Updating ppp to 2.4.5-x breaks NetworkManager-pptp vpn connection...
|| [[#t16:55:20|16:55]]
|- id="t16:56:53"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: hrmm, yeah if there's something there that could have been detecting with rpmguard, we can get a ticket in for a future test case idea
|| [[#t16:56:53|16:56]]
|- id="t16:57:02"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so for process ... I had a few things
|| [[#t16:57:02|16:57]]
|- id="t16:57:28"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Move User:Liam/Draft_Install_Test_SOP out of draft status - to me this is part of making install testing easier
|| [[#t16:57:28|16:57]]
|- id="t16:57:54"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Move User:Poelstra/blocker_bug_meeting_sop out of draft status - adamw had some improvements during FUDCon, I think we just need to dust it off before the blocker reviews kick in again
|| [[#t16:57:54|16:57]]
|- id="t16:58:07"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Draft a SOP (or extract from existing BugsAndFeatureRequests page) that describes how to document bugs (e.g. common_bugs or release notes or install guide etc...)
|| [[#t16:58:07|16:58]]
|- id="t16:58:32"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | ^^^ I'm a simple caveman ... so the docs might already be out there, but I could stand to be reminded how we advise folks on documenting issues
|| [[#t16:58:32|16:58]]
|- id="t16:58:51"
! style="background-color: #818144" | adamw
| style="color: #818144" | we don't have anything really
|| [[#t16:58:51|16:58]]
|- id="t16:59:00"
! style="background-color: #818144" | adamw
| style="color: #818144" | well, each document advises people how to contribute to it
|| [[#t16:59:00|16:59]]
|- id="t16:59:08"
! style="background-color: #818144" | adamw
| style="color: #818144" | the common_bugs page advises how to add to the common_bugs page
|| [[#t16:59:08|16:59]]
|- id="t16:59:17"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info Draft/promote a recommended test checklist for rawhide testers (for example see User:Jlaska/Draft2) - this is something spot discussed a while ago and adamw drafted an idea.  I think it would be worthwhile to reference from the QA/Joining page ... ideas?
|| [[#t16:59:17|16:59]]
|- id="t16:59:19"
! style="background-color: #818144" | adamw
| style="color: #818144" | the docs team have a page explaining how to contribute to the release notes
|| [[#t16:59:19|16:59]]
|- id="t16:59:53"
! style="background-color: #818144" | adamw
| style="color: #818144" | jlaska: we could probably stick it up as a page and just link it from one of the existing sections on Joining
|| [[#t16:59:53|16:59]]
|- id="t16:59:55"
! style="background-color: #818144" | adamw
| style="color: #818144" | off the top of my head
|| [[#t16:59:55|16:59]]
|- id="t17:00:08"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | adamw: yeah true ... I was looking for a single page that had pointed to the instructions and helped advise which place was relevant for different bugs
|| [[#t17:00:08|17:00]]
|- id="t17:00:36"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #info #  'How to debug &lt;component&gt; problems?' -- Determine whether guides can be offered by Fedora QA as a result of a test day/feature process. - Viking-Ice already discussed this previously
|| [[#t17:00:36|17:00]]
|- id="t17:00:46"
! style="background-color: #818144" | adamw
| style="color: #818144" | jlaska: the problem with that is, what would drive people to the central page?
|| [[#t17:00:46|17:00]]
|- id="t17:01:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | just like all other debug guides and doc pages ... we would
|| [[#t17:01:01|17:01]]
|- id="t17:01:13"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | in our IRC discussions, mailing list interactions etc
|| [[#t17:01:13|17:01]]
|- id="t17:01:13"
! style="background-color: #818144" | adamw
| style="color: #818144" | jlaska: well i don't see a natural flow, a real role for this central page
|| [[#t17:01:13|17:01]]
|- id="t17:01:21"
! style="background-color: #818144" | adamw
| style="color: #818144" | hmm, i see
|| [[#t17:01:21|17:01]]
|- id="t17:01:28"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | you don't .. cause you are the natural flow for this stuff! :D
|| [[#t17:01:28|17:01]]
|- id="t17:01:37"
! style="background-color: #818144" | adamw
| style="color: #818144" | well that's what i'm trying to explain in a crappy way =)
|| [[#t17:01:37|17:01]]
|- id="t17:01:41"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | hehe
|| [[#t17:01:41|17:01]]
|- id="t17:02:02"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I can take that action on that one for the release
|| [[#t17:02:02|17:02]]
|- id="t17:02:06"
! style="background-color: #818144" | adamw
| style="color: #818144" | usually i can see a sorta natural 'place' for a new wiki page, where it would fit into the flow of reference from page to page...i'm not sure i can see a real good place for something new here...maybe beland would have an idea how to structure it
|| [[#t17:02:06|17:02]]
|- id="t17:02:41"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | oooh, yeah he has a way with those kinds of wiki changes
|| [[#t17:02:41|17:02]]
|- id="t17:03:00"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I can reach out to beland for guidance/ideas if that makes sense
|| [[#t17:03:00|17:03]]
|- id="t17:03:04"
! style="background-color: #818144" | adamw
| style="color: #818144" | sure
|| [[#t17:03:04|17:03]]
|- id="t17:03:15"
! style="background-color: #818144" | adamw
| style="color: #818144" | maybe he can come up with a mockup that'd make me go 'ohhh yeah'
|| [[#t17:03:15|17:03]]
|- id="t17:03:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay
|| [[#t17:03:20|17:03]]
|- id="t17:04:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #action jlaska to reach out to beland for guidance/ideas on how to document the process (or point to existing documentation) for how bugs are noted (common_bugs, release notes, install guide etc...)  How to determine which bugs land in which place
|| [[#t17:04:23|17:04]]
|- id="t17:05:10"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic F-13 QA Recommendations - communication
|| [[#t17:05:10|17:05]]
|- id="t17:05:13"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Communication_4
|| [[#t17:05:13|17:05]]
|- id="t17:05:20"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I'm not going to spend time on this section, we discussed it earlier
|| [[#t17:05:20|17:05]]
|- id="t17:05:55"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | so ... any other thoughts/concerns on the recommendations
|| [[#t17:05:55|17:05]]
|- id="t17:05:58"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I think we have a lot of good ideas
|| [[#t17:05:58|17:05]]
|- id="t17:06:22"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | and I'd like for us to look back on this page after F-13 ... and say ... great, we did X% of what we said we would
|| [[#t17:06:22|17:06]]
|- id="t17:06:30"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | regardless of what the value of X is
|| [[#t17:06:30|17:06]]
|- id="t17:06:43"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | okay ... let's move on to open discussion
|| [[#t17:06:43|17:06]]
|- id="t17:06:49"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #topic Open discussion - &lt;your topic here&gt;
|| [[#t17:06:49|17:06]]
|- id="t17:08:18"
! style="background-color: #818144" | adamw
| style="color: #818144" | nothing here
|| [[#t17:08:18|17:08]]
|- id="t17:08:23"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | &lt;crickets&gt;
|| [[#t17:08:23|17:08]]
|- id="t17:08:39"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | well, happy new year everyone and welcome back :)
|| [[#t17:08:39|17:08]]
|- id="t17:08:46"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | I'm sure folks are still digging out from under email
|| [[#t17:08:46|17:08]]
|- id="t17:08:49"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | I propose that Fedora QA uses it's extensive forces and influences in the whole world to get a softer toilet paper to public toilets and conduct massive everyday testing on those paper..
|| [[#t17:08:49|17:08]]
|- id="t17:09:04"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | in the year 2010
|| [[#t17:09:04|17:09]]
|- id="t17:09:15"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | Viking-Ice: I'd like to see that test plan!
|| [[#t17:09:15|17:09]]
|- id="t17:09:31"
! style="background-color: #4b904b" | kparal
| style="color: #4b904b" | :))
|| [[#t17:09:31|17:09]]
|- id="t17:09:51"
! style="background-color: #8c4a4a" | Viking-Ice
| style="color: #8c4a4a" | I need to redraw it I accidentally flushed it down the drain..
|| [[#t17:09:51|17:09]]
|- id="t17:10:01"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | well, on that note  ...
|| [[#t17:10:01|17:10]]
|- id="t17:10:04"
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | #endmeeting
|| [[#t17:10:04|17:10]]
|}
Generated by irclog2html.py 2.7 by [mailto:marius@pov.lt Marius Gedminas] - find it at [http://mg.pov.lt/irclog2html mg.pov.lt]!

Revision as of 17:42, 4 January 2010

Attendees

People present (lines said) 

* jlaska (154)
* adamw (57)
* Viking-Ice (19)
* maxamillion (17)
* wwoods (12)
* kparal (8)
* nirik (4)
* zodbot (3)
* buggbot (1)

Regrets:

Agenda

  • [FIXME Proposed meeting agenda]
  • [FIXME meetbot summary]

Previous meeting follow-up

  1. jlaska to post recommendations on F-12 QA retrospective
  2. adamw to escalate security policy issue to fesco
  3. jlaska to set up a meeting to co-ordinate test plan changes for F13
  4. adamw and jlaska to look at setting up f13 test day process

F-13 Recommendations

Discussion around the proposed QA changes for F-13 based on Fedora_12_QA_Retrospective#Recommendations . Begin identifying gaps and owners.

Open discussion - <Your topic here>

Upcoming QA events

  • 2010-01-21 - Pre-Alpha Rawhide Acceptance Test Plan #1
  • 2010-01-28 - Pre-Alpha Rawhide Acceptance Test Plan #2
  • 2010-01-04 - Pre-Alpha Rawhide Acceptance Test Plan #3
  • 2010-02-05 - Alpha Blocker Meeting (F13Alpha) #1
  • 2010-02-11 - Test Alpha 'Test Compose' (boot media testing)
  • 2010-02-12 - Alpha Blocker Meeting (F13Alpha) #2

Action items

  • Viking-Ice investigating adding an LXDE test day to the F-13 test day schedule
  • maxamillion investigating scheduling a XFCE test day to F-13 test day schedule
  • adamw and rhe to discuss ways to add install testing as a QA activity
  • jlaska will reach out to mclasen for thoughts on F-13 fit'n'finish test days
  • jlaska to reach out ot fedora-{test,devel}-list for trading reviews
  • jlaska to reach out to beland for guidance/ideas on how to document the process (or point to existing documentation) for how bugs are noted (common_bugs, release notes, install guide etc...) How to determine which bugs land in which place


IRC transcript

jlaska #startmeeting Fedora QA Meeting 16:01
zodbot Meeting started Mon Jan 4 16:01:14 2010 UTC. The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:01
zodbot Useful Commands: #action #agreed #halp #info #idea #link #topic. 16:01
jlaska #meetingname qa 16:01
zodbot The meeting name has been set to 'qa' 16:01
jlaska #topic gathering 16:01
adamw hellllo 16:02
jlaska Howdy folks ... let's do a show of hands 16:02
* wwoods shows off his hands 16:02
jlaska ooh, look at those hands 16:02
wwoods theyr'e the new '10 model 16:02
* kparal waves too 16:02
adamw who'd you cut them off? and where'd you get the jars? 16:02
* Viking-Ice raises his hand for a high five on the new year.. 16:02
wwoods Viking-Ice: o/ \o 16:03
jlaska down low 16:03
adamw wwoods can give you a high twenty 16:03
jlaska alright ... let's get things started 16:04
jlaska we've got a light agenda today ... but always room for 'open discussion' 16:04
jlaska #topic Previous meeting follow-up 16:04
jlaska okay ... trying to figure out which meeting was the previous 16:04
jlaska the last set of tasks I'm tracking are listed at https://fedoraproject.org/wiki/QA/Meetings/20100104#Previous_meeting_follow-up 16:05
jlaska #info jlaska to post recommendations on F-12 QA retrospective 16:05
jlaska these are posted and available at https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Recommendations 16:05
jlaska I've left most of the agenda for walking through this 16:05
jlaska next I've got ... 16:06
jlaska #info adamw to escalate security policy issue to fesco 16:06
jlaska I don't have any updates on that one ... did that already happen? 16:07
adamw err. i think i filed a ticket. just a sec 16:07
adamw yeah, I did 16:07
adamw https://fedorahosted.org/fesco/ticket/297 16:07
jlaska ah great 16:08
adamw no reply yet 16:08
* jlaska lost the linky 16:08
jlaska so that'll come up for discussion at the next FESCO meeting right? 16:08
jlaska Next up ... 16:08
jlaska #info jlaska to set up a meeting to co-ordinate test plan changes for F13 16:08
jlaska We had a quick sprint the week prior to Christmas with adamw, lili, rhe and myself walking through the list of F-13 test plan tickets 16:09
jlaska still lots of kinks to iron out in the sprint process, and there are still a few inprogress tickets 16:10
* jlaska searches for ticket query 16:10
jlaska https://fedorahosted.org/fedora-qa/query?status=new&status=assigned&status=reopened&component=Test+Review&milestone=Fedora+13&order=priority 16:11
jlaska I'll circle back and bump the status on a few of those later today 16:11
jlaska last item ... 16:11
jlaska #info adamw and jlaska to look at setting up f13 test day process 16:11
jlaska No updates from me on this ... I'd like to chat w/ adamw this week to iron out an approach 16:12
maxamillion is there something that is going to be greatly different from the last test day process(es)? 16:12
jlaska we've got initial ideas posted to the wiki already ... https://fedoraproject.org/wiki/Talk:QA/Fedora_13_test_days 16:12
jlaska maxamillion: I don't expect so ... just need to get on top of it and actively work the schedule 16:13
jlaska okay, anything not mentioned? 16:13
maxamillion ah, nice 16:13
maxamillion I'll be sure to read that later 16:13
jlaska if not ... we'll jump into the F-13 QA recommendations 16:14
jlaska maxamillion: cool, and of course, test day topic suggestions encouraged too! 16:14
jlaska #topic F-13 QA Recommendations 16:14
jlaska So ... I've taking all the QA retrospective feedback and tried to organize things into several groups 16:14
maxamillion jlaska: I'll be working with kevin and christoph on the xfce spin test day plans and try to add suggestions if I find any :) 16:15
jlaska maxamillion: awesome, that's just what I had in mind. Any additional spin test days would be fun (much like the sugar event) 16:15
Viking-Ice I was thinking about going knee deep in LXDE so I should be able to write something.. 16:15
maxamillion Viking-Ice: be sure to touch base with cwickert, i'm sure he'd welcome the interest in LXDE 16:16
jlaska so I've organized the feedback into the following themes: process, planning, communication and automation 16:16
jlaska these aren't hard themes, just what bubbled up from how I read the data 16:16
jlaska so there is overlap between these themes .. but in general, I was happy with the grouping 16:17
Viking-Ice maxamillion: I was planning to hear from him.. 16:17
maxamillion Viking-Ice: cool cool :) 16:17
jlaska maxamillion: Viking-Ice should I add an action item for next week on this? or too soon? 16:17
jlaska ^--> re: LXDE and XFCE spin test days? 16:17
Viking-Ice you can add action item for me 16:18
jlaska okay 16:18
maxamillion we could do next week, that would give me a bit of motivation to get on the ball about it 16:18
maxamillion errr I* 16:18
* Viking-Ice works best under pressure.. 16:18
jlaska #action Viking-Ice investigating adding an LXDE test day to the F-13 test day schedule 16:18
jlaska #action maxamillion investigating scheduling a XFCE test day to F-13 test day schedule 16:19
maxamillion w00t! my first action item in the QA world :P 16:20
jlaska maxamillion: heh, you've arrived :D 16:20
jlaska so have folks had a chance to look through the recommendations? 16:20
jlaska https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Recommendations 16:20
jlaska there shouldn't be surprises there ... I've basically reorganized the feedback provided 16:21
jlaska what I'd like to do is walk through the list and see if we can identify owners for some of the tasks 16:21
maxamillion jlaska: do you want to #link that so its in the minutes? (that might not even be the right tag, but you get the idea) :) 16:21
jlaska maxamillion: sure ... 16:21
jlaska #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Recommendations 16:22
adamw just refreshing my memory 16:22
jlaska many of the listed recommendations are things several of you are already on top of 16:23
adamw i could take "Promote install testing as a QA activity" 16:23
jlaska adamw: thanks, Hurry has some ideas on this already ... would you two like to sync up? 16:24
jlaska perhaps her experience on the install side iwth your wiki mastery can come up with some good ideas 16:24
adamw also most of the 'communication' stuff 16:24
adamw well yeah i was just meaning i could do the wiki bits 16:25
adamw stick me in a #action 16:25
Viking-Ice I need a little explanation with this "Determine whether guides can be offered by Fedora QA as a result of a test day/feature process" 16:25
jlaska #action adamw and rhe to discuss ways to add install testing as a QA activity 16:25
jlaska adamw: kparal had some social networking suggestions already, perhaps we can divide and conquer there? 16:26
jlaska Viking-Ice: my thinking there was to follow your lead for dracut 16:26
kparal not really mine suggestions, but I can help 16:26
jlaska kparal: oh right ...these were from the lunch'n'learn 16:26
kparal correct 16:27
Viking-Ice Advertice on the Fedora Project network on FB 16:27
jlaska Viking-Ice: basically, that dracut debug page rocks ... I'd like to see we can follow that model again for maybe a few features? 16:27
jlaska what do you think? 16:27
Viking-Ice sounds raz.. 16:27
Viking-Ice I'll run through the feature stuff and see what I can write.. 16:28
jlaska Viking-Ice: sweet, I think that would be tremendously helpful. I just don't know a good way to target specfiic features 16:28
jlaska dracut was a good choice since it was something *everyone* would need 16:28
jlaska perhaps python3 might be similar in that regard? or others 16:29
jlaska #link https://fedoraproject.org/wiki/Releases/13/FeatureList 16:30
jlaska #topic F-13 QA Recommendations - test planning 16:30
jlaska on the test planning front ... much of this is already underway 16:31
jlaska #info Maintenance of the Fedora Install Test Plan - Liam and Hurry are doing a lot of heavy lifting here 16:31
jlaska #info Draft a more formal, but basic and lightweight, security checklist/test plan - discussed earlier, adamw has a fesco ticket filed ... stay tuned 16:31
jlaska #info Draft a test plan to cover the desktop verification from Fedora_Release_Criteria 16:32
jlaska #link https://fedoraproject.org/wiki/Fedora_Release_Criteria 16:32
kparal I noticed adamw is creating test plan for the desktop stuff: https://fedoraproject.org/wiki/Category:Desktop_Acceptance_Test_Cases 16:32
adamw yeah, i'm in teh middle of that 16:32
adamw got about halfway through before the xmas break 16:32
adamw will be back on it this week 16:32
jlaska kparal: perfect, thanks for the link 16:32
kparal I will gladly help with that if time permits 16:33
adamw sure, if anyone wants to chip in tests that'd be great 16:33
Viking-Ice I think we need to get in touch with the X team to come up with an formal Xorg test plan ( not just x11-drv-* ) 16:33
jlaska Viking-Ice: good segway ... that was next 16:33
adamw well we talked about that quite a lot at the sprint 16:33
jlaska #info We have no formal Xorg-x11-drv test plan ... either create one, or develop proposal for gathering the same feedback through other means (smolt, bugzilla) 16:33
adamw i actually don't think a test plan for X would achieve much 16:33
adamw we started doing a test matrix then realized it was pretty pointless 16:33
jlaska adamw: can you talk more about how we came to that conclusion? 16:34
adamw the tricky thing with X is that the main problem with it is that we're dealing with seventy zillion different bits of hardware 16:34
jlaska yeah that ---^ :) 16:34
adamw and the level of functionality we currently care about is pretty basic, this isn't really deep level stuff 16:34
maxamillion I think there could be a matrix of hardware and "Works for Me" and maybe some break down of how much works (KMS, direct rendering, etc) 16:34
adamw the types of problems we get with X are not 'this one out of the millions of really complex levels of functionality suddenly regressed' but 'o shit this card doesn't work any more' 16:35
adamw maxamillion: that would rapidly get HORRIBLY unsustainable 16:35
jlaska maxamillion: if someone wanted to look into how to pull this out of smolt and present the information ... that would be a fun project 16:35
adamw i really can't emphasize the amount of hardware we're talking about here enough 16:35
maxamillion adamw: for a test day? 16:35
Viking-Ice what about input ( keyboards usb etc ) and for example multitouch ? 16:35
maxamillion or you mean long term 16:35
adamw we already do test days 16:35
maxamillion ? 16:35
maxamillion oh ok, i misunderstood 16:35
adamw we're talking about some kind of test plan 16:35
maxamillion sorry, I'm in a meeting at $dayjob and trying to keep up with this one ... don't mind me :P 16:36
adamw i just don't think that's an approach that fixes the X situation; it's not the paradigm that addresses the kinds of problems we actually get with X 16:36
maxamillion adamw: yeah, I agree 16:36
jlaska maxamillion: no it's a good suggestion ... it's just trying to figure out how to sustainably execute the plan and track the data 16:36
adamw Viking-Ice: um. in theory an input matrix is a useful idea, but in practice it kinda depends how much we care about anything besides basic mouse+keyboard stuff 16:36
adamw er, s/matrix/test plan/ 16:37
adamw multitouch is way too basic at this point to worry about 16:37
adamw you can't really _use_ it in any meaningful way yet 16:37
adamw jlaska still reckons some kind of test plan for X is a good idea, but i still don't quite understand exactly what we can achieve with one that we're not achieving already; this is where we left it in the sprint :) 16:37
jlaska one way we can use the existing test cases is much how they've been used so far 16:37
jlaska for test days and for use to help isolate the true failure of reported bugs 16:38
Viking-Ice adamw: Ok Talking about meaningful did we receive any feed back from nirik and others on the front ( forums #fedora etc ) about what they get bombarded with ( perhaps something we should track and target for test days ) 16:39
jlaska Viking-Ice: good suggestion 16:39
* nirik looks up. 16:39
adamw well, i'm mostly on teh front for X stuff, and yeah, we do co-ordinate a bit on that 16:39
nirik you mean specific stuff? or in general areas we see a lot of stuff? 16:40
jlaska nirik: other soft spots from the F-12 release that could modify the QA plan for F-13 16:40
Viking-Ice all proprietary aside the issues most end users are faced with 16:40
adamw i don't think we can add much to our process based on that feedback. i'd say broadly what you get splits into two camps: 'HELP MY X/COMPIZ DOESN'T WORK' and 'HELP MY PROPRIETARY DRIVER DOESN'T WORK' 16:40
adamw second is out of our scope 16:40
adamw first is already covered 16:40
* nirik nods. 16:40
jlaska true 16:40
jlaska okay ... last I have on the planning side is Test Days 16:41
adamw as i said, X is fundamentally a shallow area: the issues are due to hardware variety (and the developers rewriting everything every three months). there just isn't a complex tangle of functionality to test 16:41
jlaska adamw: if we had a pull of every hardware adapter available ... would there be some type of feedback to provide to X maintainers that would be valuable? 16:42
nirik having the list of workarounds especially for install has been great on the common bugs list. 16:42
jlaska oh god ... s/pull/pool/ 16:42
adamw well, yeah. if we had a Big Test Lab with every graphics adapter in the world in it, sure. what they'd be interested in is knowing with every day's rawhide which systems basically worked. for bonus points, which could do enough 3D to run compiz. 16:43
jlaska heh 16:43
adamw i mean, that's really it. like i keep saying, it's not complicated =) 16:43
jlaska adamw: so instead, we have a highly distributed test lab 16:43
adamw there was that thread about 'stop working on rawhide and work on f12' or whatever on devel-list 16:43
wwoods (if you consider the set of Interested Fedora Users as a distributed test lab..) 16:43
adamw dave airlie (or ajax, I forget) posted the X team's List Of Things We Really Care About to that thread, which is basically what I just said 16:44
jlaska wwoods: true true 16:44
jlaska adamw: gotcha 16:44
jlaska alright ... so last I had on the planning topic was test days 16:44
jlaska anyone know if they are plans to revisit the 'fit and finish' events? 16:44
Viking-Ice adamw: Big Test Lab the world not enough ;) 16:44
jlaska if not, I can follow-up w/ mclasen 16:44
adamw sure. how i look at that is that the blocking points in that way of looking at things all involve making the lab work efficiently. the test plan is not part of that. the test plan defines _what to test_, which as I keep saying is really simple and everyone knows it already 16:44
adamw all the problems with X testing, if we look at the 'the world is a big test lab' theory, lie in actually co-ordinating the distributed systems and people who make up the 'lab' to do testing and provide useful info. which a test plan can't really help with, i don' think. but hey. sorry, jlaska wants to move on :) 16:45
jlaska adamw, no thanks ... you explained it better than I could have hoped to 16:46
Viking-Ice Let's move along.. 16:46
jlaska #action jlaska will reach out to mclasen for thoughts on F-13 fit'n'finish test days 16:47
jlaska okay ... any other suggestions on the test planning side for F-13? 16:47
jlaska for reference ... https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Test_Planning_3 16:47
jlaska alright ... the next group is where wwoods and kparal rock 16:48
jlaska #topic F-13 QA Recommendations - test automation 16:48
jlaska #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Test_Automation 16:48
jlaska The first obvious one is ... 16:48
jlaska #info Deploy AutoQA 'is rawhide broken?' front-end into fedora infrastructure 16:49
jlaska this is inprogress ... and going through package review at the moment 16:49
jlaska #action jlaska to reach out ot fedora-{test,devel}-list for trading reviews 16:49
jlaska #info Deploy build-time sanity checking mechanism for package maintainers (rpmguard, rpmlint etc...) 16:49
jlaska Kamil and Will are knee deep in this now 16:49
jlaska with both rpmlint and rpmguard working into the system 16:50
kparal and will be deeper :) 16:50
jlaska hehe 16:50
jlaska The last item I have here is 16:50
jlaska #ifo Develop proof-of-concept for automating install test matrix 16:50
jlaska #info Develop proof-of-concept for automating install test matrix 16:50
wwoods I'm pretty sure rpmguard will obsolete rpmlint eventually 16:50
kparal I don't think so, they have different goal 16:51
jlaska Liam and Hurry are working towards a automated DVD install test at the moment ... and then likely will need wwoods expertise for integrating the tests into AutoQA 16:51
wwoods kparal: hm, good point 16:51
wwoods jlaska: yeah, I think this will probably be my first big goal for the new year? 16:51
jlaska wwoods: cool, this would be huge to see traction on before F-13 kicks into high gear 16:52
jlaska Liam was looking into playing with install.py over the break and expanding it to do a basic DVD install ... I'll be checking in to see how he's making out soon 16:52
jlaska anything else under automation that wasn't covered ... that needs to be on the radar? 16:52
wwoods yeah, IIRC it involves designing a test that takes as input: 16:52
wwoods 1) a description of the test system hardware (disks, disk sizes), 16:53
wwoods 2) a kickstart (which describes partitioning etc), 16:53
wwoods 3) an installable tree/image 16:53
jlaska yeah, I should have cc'd you on the mail I sent him 16:53
jlaska basically the same list of inputs 16:53
wwoods pretty sure a test that would do that would cover the entire test matrix, but we'll see 16:53
jlaska okay ... we touched on each of the other sections already but here they are for the logs 16:54
jlaska #topic F-13 QA Recommendations - process 16:55
jlaska #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Process_4 16:55
Viking-Ice One thing that came to my mind when I hit bug 549944 is this something we can automate an test for ( looks like version mismatch ) 16:55
buggbot Bug https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=549944 medium, low, ---, jskala, NEW, Updating ppp to 2.4.5-x breaks NetworkManager-pptp vpn connection... 16:55
jlaska Viking-Ice: hrmm, yeah if there's something there that could have been detecting with rpmguard, we can get a ticket in for a future test case idea 16:56
jlaska so for process ... I had a few things 16:57
jlaska #info Move User:Liam/Draft_Install_Test_SOP out of draft status - to me this is part of making install testing easier 16:57
jlaska #info Move User:Poelstra/blocker_bug_meeting_sop out of draft status - adamw had some improvements during FUDCon, I think we just need to dust it off before the blocker reviews kick in again 16:57
jlaska #info Draft a SOP (or extract from existing BugsAndFeatureRequests page) that describes how to document bugs (e.g. common_bugs or release notes or install guide etc...) 16:58
jlaska ^^^ I'm a simple caveman ... so the docs might already be out there, but I could stand to be reminded how we advise folks on documenting issues 16:58
adamw we don't have anything really 16:58
adamw well, each document advises people how to contribute to it 16:59
adamw the common_bugs page advises how to add to the common_bugs page 16:59
jlaska #info Draft/promote a recommended test checklist for rawhide testers (for example see User:Jlaska/Draft2) - this is something spot discussed a while ago and adamw drafted an idea. I think it would be worthwhile to reference from the QA/Joining page ... ideas? 16:59
adamw the docs team have a page explaining how to contribute to the release notes 16:59
adamw jlaska: we could probably stick it up as a page and just link it from one of the existing sections on Joining 16:59
adamw off the top of my head 16:59
jlaska adamw: yeah true ... I was looking for a single page that had pointed to the instructions and helped advise which place was relevant for different bugs 17:00
jlaska #info # 'How to debug <component> problems?' -- Determine whether guides can be offered by Fedora QA as a result of a test day/feature process. - Viking-Ice already discussed this previously 17:00
adamw jlaska: the problem with that is, what would drive people to the central page? 17:00
jlaska just like all other debug guides and doc pages ... we would 17:01
jlaska in our IRC discussions, mailing list interactions etc 17:01
adamw jlaska: well i don't see a natural flow, a real role for this central page 17:01
adamw hmm, i see 17:01
jlaska you don't .. cause you are the natural flow for this stuff! :D 17:01
adamw well that's what i'm trying to explain in a crappy way =) 17:01
jlaska hehe 17:01
jlaska I can take that action on that one for the release 17:02
adamw usually i can see a sorta natural 'place' for a new wiki page, where it would fit into the flow of reference from page to page...i'm not sure i can see a real good place for something new here...maybe beland would have an idea how to structure it 17:02
jlaska oooh, yeah he has a way with those kinds of wiki changes 17:02
jlaska I can reach out to beland for guidance/ideas if that makes sense 17:03
adamw sure 17:03
adamw maybe he can come up with a mockup that'd make me go 'ohhh yeah' 17:03
jlaska okay 17:03
jlaska #action jlaska to reach out to beland for guidance/ideas on how to document the process (or point to existing documentation) for how bugs are noted (common_bugs, release notes, install guide etc...) How to determine which bugs land in which place 17:04
jlaska #topic F-13 QA Recommendations - communication 17:05
jlaska #link https://fedoraproject.org/wiki/Fedora_12_QA_Retrospective#Communication_4 17:05
jlaska I'm not going to spend time on this section, we discussed it earlier 17:05
jlaska so ... any other thoughts/concerns on the recommendations 17:05
jlaska I think we have a lot of good ideas 17:05
jlaska and I'd like for us to look back on this page after F-13 ... and say ... great, we did X% of what we said we would 17:06
jlaska regardless of what the value of X is 17:06
jlaska okay ... let's move on to open discussion 17:06
jlaska #topic Open discussion - <your topic here> 17:06
adamw nothing here 17:08
jlaska <crickets> 17:08
jlaska well, happy new year everyone and welcome back :) 17:08
jlaska I'm sure folks are still digging out from under email 17:08
Viking-Ice I propose that Fedora QA uses it's extensive forces and influences in the whole world to get a softer toilet paper to public toilets and conduct massive everyday testing on those paper.. 17:08
Viking-Ice in the year 2010 17:09
jlaska Viking-Ice: I'd like to see that test plan! 17:09
kparal :)) 17:09
Viking-Ice I need to redraw it I accidentally flushed it down the drain.. 17:09
jlaska well, on that note ... 17:10
jlaska #endmeeting 17:10

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!

Retrieved from "https://fedoraproject.org/w/index.php?title=QA/Meetings/20100104&oldid=143760"