From Fedora Project Wiki

< QA‎ | Meetings

(Updated notes)
m (internal link cleaning)
 
Line 250: Line 250:
|| [[#tAug 03 12:04:48|Aug 03 12:04]]  
|| [[#tAug 03 12:04:48|Aug 03 12:04]]  
|- id="tAug 03 12:04:59"
|- id="tAug 03 12:04:59"
| colspan="2" | * | jlaska operating out of proposed agenda at https://fedoraproject.org/wiki/QA/Meetings/20090803
| colspan="2" | * | jlaska operating out of proposed agenda at [[QA/Meetings/20090803]]
|| [[#tAug 03 12:04:59|Aug 03 12:04]]
|| [[#tAug 03 12:04:59|Aug 03 12:04]]
|- id="tAug 03 12:05:10"
|- id="tAug 03 12:05:10"
Line 948: Line 948:
|- id="tAug 03 12:49:54"
|- id="tAug 03 12:49:54"
! style="background-color: #407a40" | jlaska
! style="background-color: #407a40" | jlaska
| style="color: #407a40" | | https://fedoraproject.org/wiki/QA/Meetings/20090727#AutoQA_update
| style="color: #407a40" | | [[QA/Meetings/20090727#AutoQA_update]]
|| [[#tAug 03 12:49:54|Aug 03 12:49]]  
|| [[#tAug 03 12:49:54|Aug 03 12:49]]  
|- id="tAug 03 12:50:42"
|- id="tAug 03 12:50:42"
Line 1,059: Line 1,059:
|- id="tAug 03 12:56:49"
|- id="tAug 03 12:56:49"
! style="background-color: #539e9e" | wwoods
! style="background-color: #539e9e" | wwoods
| style="color: #539e9e" | | #link https://fedoraproject.org/wiki/QA:Rawhide_Acceptance_Test_Plan
| style="color: #539e9e" | | #link [[QA:Rawhide_Acceptance_Test_Plan]]
|| [[#tAug 03 12:56:49|Aug 03 12:56]]  
|| [[#tAug 03 12:56:49|Aug 03 12:56]]  
|- id="tAug 03 12:57:34"
|- id="tAug 03 12:57:34"
Line 1,302: Line 1,302:
|- id="tAug 03 13:10:20"
|- id="tAug 03 13:10:20"
! style="background-color: #539e9e" | wwoods
! style="background-color: #539e9e" | wwoods
| style="color: #539e9e" | | https://fedoraproject.org/wiki/Autotest
| style="color: #539e9e" | | [[Autotest]]
|| [[#tAug 03 13:10:20|Aug 03 13:10]]  
|| [[#tAug 03 13:10:20|Aug 03 13:10]]  
|- id="tAug 03 13:10:23"
|- id="tAug 03 13:10:23"

Latest revision as of 08:58, 18 September 2016

Attendees

  • James Laska (jlaska)
  • Jóhann Guðmundsson (viking-ice)
  • John Poelstra (poelcat)
  • Jesse Keating (f13)
  • Will Woods (wwoods)
  • Denise Dumas (denise)
  • Josh Boyer (jwb)
  • Warren Togami (warren)

Regrets:

  • Adam Williamson (adamw)
  • David Pravec (dpravec)
  • Kamil Paral (kparal)
  • Liam Li (lili)
  • He Rui (rhe)


Agenda

Proposed meeting agenda

Previous meeting follow-up

  1. [jlaska] - file bug against distribution for rawhide pungi problems
    • Filed and fixed. See RHBZ #514062
  2. [poelcat] - to send blocker bug meeting announce
  3. [adamw] - to summarize blocker meeting
  4. [dpravec] - posting some fun ascii art for blocker bug meeting
    • Posted ... hilarity ensued (see minutes)
  5. [jlaska] - talk to warren about a rawhidewatch post on rpm xz workaround for rawhide testers
  6. [kparal] - investigate updates to Test Day livecd-creator instructions

Dracut rawhide testing update

Viking_ice updated the team with notes from his discussion on the current state of Dracut with Harald Hoyer.

Harald, pjones, davej (kernel) and jwrdegoede (anaconda) are currently investigating the swithover for rawhide. They indicated the most common setups should be operational and the target for the upcoming dracut test day will be focusing on:

  • networked root volumes (e.g. iscsi and fcoe)
  • complex raid/lvm setups

f13 also informed the group that one of the hurdles to network root volumes involved the %buildrequires of the kernel and firmware that's packaged outside the kernel for network storage, network cards and scsi cards.

Viking-Ice plans to stay in touch with Harald to keep on top of test days and test case writing.

In the news

Alpha test compose

Jlaska informed the team that it appears the udev issue blocking installation last week was resolved with a patch from clumens and jeremy (see http://git.fedorahosted.org/git/?p=anaconda.git;a=commit;h=e6402846cae226519bfc34feb4f92b40d3bf0885). There was some confusion as to whether this was the final approved fix. Denise Dumas confirmed this was the fix agreed on by clumens and jeremy.

Question(s) to answer:

  1. When to build the test compose?
    • Jlaska took an action item to update the rel-eng test compose ticket with current status (see https://fedorahosted.org/rel-eng/ticket/2016).
    • Jkeating took an action item to update the ticket so Liam can proceed with community testing of the test compose.
  2. What impact does this have on the Alpha?
    • Jlaska suggested we will begin filling out the matrix but are behind by 4 days. I don't think this means a slip is required yet ... but it's a good indicator if we begin to miss other alpha targets.

Once test compose is available, Liam Li has invited install testers to contribute results against the upcoming Alpha Candidate.

Upcoming release events:

  • 2009-07-29 - MISSED - Alpha Test Compose
  • 2009-08-06 - Compose Alpha Candidate
  • 2009-08-06 - 2009-08-13 - Test Alpha Candidate
  • 2009-08-10 - Alpha go/no_go
  • 2009-08-13 - Sync to mirrors

Alpha blocker bug day#4

No alpha blocker meeting is scheduled for this Friday. Given that the test compose hasn't been built, do folks feel review of the forthcoming blockers is desired?

Some discussion followed on the usefulness of a Friday blocker bug meeting, and a Monday go/no go meeting. In the end, the decision was to host a Friday blocker bug meeting as has been done in the previous 3 Fridays. Ideally, this should facilitate a faster go/no_go meeting on Monday.

  • Jlaska will send out meeting announcement
  • Poelcat agreed to help provide a meeting summary

AutoQA update

Update from Will Woods on recent AutoQA efforts. Last week wwoods finished the remaining test of the 'installation' portion. Which is to say that we now have a test script that:

  1. downloads images
  2. starts a virt guest
  3. logs serial console output until loader / stage1 starts
  4. logs serial console output until stage2 gets loaded
  5. downloads all anaconda logs from guest as it runs the installation
  6. declares success if anaconda finds and formats the disks.
  7. declares failure if the guest either ...
    • goes silent for 60 seconds or more, or
    • takes more than ~10 minutes without finding the disks
    • if anaconda traces back

Next steps ...

  1. Continue documenting test writing instructions at Autotest (and Talk page)
  2. Make it run automatically when we get a new rawhide
  3. Those results somewhere useful

Open discussion

<your topic here>

No open discussion topics were raised.

Upcoming QA events

Action items

  • <insert action item here>

IRC transcript

jlaska | #startmeeting Fedora Quality Assurance Meeting Aug 03 12:00
zodbot | Meeting started Mon Aug 3 16:00:07 2009 UTC. The chair is jlaska. Information about MeetBot at http://wiki.debian.org/MeetBot. Aug 03 12:00
zodbot | Useful Commands: #action #agreed #halp #info #idea #link #topic. Aug 03 12:00
--- | zodbot has changed the topic to: (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:00
jlaska | #topic gathering essential carbon units Aug 03 12:00
--- | zodbot has changed the topic to: gathering essential carbon units (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:00
onekopaka | carbon units? Aug 03 12:00
jlaska | aka people :) Aug 03 12:00
onekopaka | we're carbon units now? Aug 03 12:00
jlaska | hehe, we've always been Aug 03 12:00
onekopaka | but we're being refered to as carbon units? Aug 03 12:01
onekopaka | that's just not nice. Aug 03 12:01
jlaska | We'll be short a few people today, including adamw, dpravec, kparal, lili and rhe Aug 03 12:01
jlaska | #topic gathering essential 'people' Aug 03 12:01
--- | zodbot has changed the topic to: gathering essential 'people' (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:01
jlaska | onekopaka: there ya go :) Aug 03 12:01
onekopaka | I'll be here for the fun of it. Aug 03 12:02
jlaska | onekopaka: okay Aug 03 12:02
jlaska | show of hands for the QA meeting Aug 03 12:02
jlaska | wwoods: Viking-Ice: you guys around? Aug 03 12:02
* | poelcat here Aug 03 12:02
* | onekopaka is looking for the rear USB ports on his ex-server Aug 03 12:02
jlaska | poelcat: welcome Aug 03 12:02
* | wwoods around Aug 03 12:04
jlaska | wwoods: hey there Aug 03 12:04
jlaska | Viking-Ice_: there he is :) Aug 03 12:04
jlaska | okay let's get started with a fairly quick review of last week Aug 03 12:04
* | jlaska operating out of proposed agenda at QA/Meetings/20090803 Aug 03 12:04
jlaska | #topic previous meeting review Aug 03 12:05
--- | zodbot has changed the topic to: previous meeting review (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:05
--- | dwmw2 is now known as dwmw2_gone Aug 03 12:05
* | f13 Aug 03 12:05
jlaska | f13: welcome! Aug 03 12:05
jlaska | most of this stuff has been done so this should be quick Aug 03 12:05
jlaska | # [jlaska] - file bug against distribution for rawhide pungi problems Aug 03 12:05
Viking-Ice_ | yup.. dont know how long I'll stay thou need to remove 3d tagets from the archery track ( group supposed to meet sometimed between 16:00 & 17:00 ) Aug 03 12:05
jlaska | done and thanks to f13 to for helping resolve the issue Aug 03 12:05
jlaska | for the logs, see bug#514062 Aug 03 12:06
buggbot | Bug https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=514062 medium, low, ---, jkeating, CLOSED RAWHIDE, Rawhide missing images Aug 03 12:06
jlaska | Viking-Ice_: okay, thanks for the heads up Aug 03 12:06
jlaska | a few action items around the blocker bug event last week ... Aug 03 12:06
jlaska | # [poelcat] - to send blocker bug meeting announce Aug 03 12:06
jlaska | thanks poelcat ... I've got the link in the logs as https://www.redhat.com/archives/fedora-test-list/2009-July/msg00655.html Aug 03 12:06
jlaska | next up ... Aug 03 12:07
jlaska | # [adamw] - to summarize blocker meeting Aug 03 12:07
jlaska | I didn't see a summary to the list on this yet, but the meetbot logs are available ... http://meetbot.fedoraproject.org/fedora-bugzappers/2009-07-31/fedora-bugzappers.2009-07-31-15.01.html Aug 03 12:08
jlaska | also from the meeting Aug 03 12:08
jlaska | dpravec kept us entertained ... Aug 03 12:08
* | poelcat can't figure out why we didn't put a blocker bug meeting on the schedule for 8/7 Aug 03 12:08
jlaska | # [dpravec] - posting some fun ascii art for blocker bug meeting Aug 03 12:08
jlaska | poelcat: yeah, I've got that in the agenda later on ... was going to ask you about it Aug 03 12:08
jlaska | Next up ... we wanted to post wwoods solution to rawhidewatch for the rpm XZ payload issue Aug 03 12:09
jlaska | # [jlaska] - talk to warren about a rawhidewatch post on rpm xz workaround for rawhide testers Aug 03 12:09
jlaska | thanks warren! http://rawhidewatch.wordpress.com/2009/07/31/unable-to-update-to-rawhide-rpmlibpayloadisxz Aug 03 12:09
jlaska | And last item from last week ... Aug 03 12:09
jlaska | # [kparal] - investigate updates to Test Day livecd-creator instructions Aug 03 12:09
warren | jlaska: you didn't get back to me regarding wordpress account Aug 03 12:09
jlaska | kparal isn't here today either, but posted updates to the test list for review https://www.redhat.com/archives/fedora-test-list/2009-July/msg00549.html Aug 03 12:09
warren | jlaska: I can grant other wordpress accounts post access to rawhidewatch Aug 03 12:10
jlaska | warren: I did ... it's just 'jlaska' Aug 03 12:10
warren | oh Aug 03 12:10
warren | ok Aug 03 12:10
jlaska | warren: thanks for reminder though, I need to revisit wordpress ;) Aug 03 12:10
warren | jlaska: what e-mail was used withi that account? Aug 03 12:10
jlaska | warren: Not sure, I'll have to follow-up with you on that Aug 03 12:11
warren | ok Aug 03 12:11
jlaska | any other updates from last week that I missed? Aug 03 12:11
* | jlaska preparing to dive into agenda Aug 03 12:11
jlaska | #topic Dracut rawhide test update Aug 03 12:12
--- | zodbot has changed the topic to: Dracut rawhide test update (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:12
jlaska | Viking-Ice_: I've got a note here to keep this on the agenda in case you had any updates to share Aug 03 12:13
* | jlaska suspects we lost Viking-Ice Aug 03 12:15
Viking-Ice_ | yup still here with updates Aug 03 12:15
* | Viking-Ice_ middle of fixing arrows :/ Aug 03 12:16
jlaska | oh cool, any news to share? Sounds like you're in the middle of a competition too ... want to hold off for mail list follow-up? Aug 03 12:16
Viking-Ice_ | No let's just finished this ( had to finish this arrow :) ) Aug 03 12:18
* | Viking-Ice_ sneaks my topic to the top Aug 03 12:18
jlaska | okay, you've got the floor ... go for it Aug 03 12:18
Viking-Ice_ | So I emailed harald Aug 03 12:18
Viking-Ice_ | And he informed me that him Dave Jones Peter Jones ( kernel ) and Hans ( Anaconda ) are making the switch in rawhide Aug 03 12:21
jlaska | Viking-Ice_: so that should be landing soon? Aug 03 12:22
Viking-Ice_ | and the target are for test days is more root on a network drive and complex raid/lvm setups. Aug 03 12:22
jlaska | right on Aug 03 12:22
Viking-Ice_ | so the most common setups should just work Aug 03 12:22
f13 | they were looking into it, then ran into a big hurdle Aug 03 12:22
f13 | regarding the buildrequires of the kernel, and I'm not sure if it actually got switched on or not Aug 03 12:22
jlaska | Viking-Ice_: any action needed in to short-term when this change occurs? Aug 03 12:24
Viking-Ice_ | Did not come with the email the progress on the switch still feel like we are missing some are ( kernel/anaconda + something else ) well maybe it's just me Aug 03 12:24
jlaska | f13: the hurdle was for the network storage cases? Aug 03 12:24
Aug 03 12:24:59<Viking-Ice_> | jlaska: nothing that got mentioned but I will stay in touch with Harald with regards to the test days and test case writing
f13 | jlaska: basically all firmware that's packaged outside the kernel, that would be interesting in the initrd Aug 03 12:25
f13 | network storage, network cards, scsi cards Aug 03 12:25
jlaska | oh hmmm Aug 03 12:25
jlaska | Viking-Ice_: okay thank you Aug 03 12:25
jlaska | so has this change already happened? Aug 03 12:26
jlaska | since we are past feature freeze now Aug 03 12:26
* | jlaska sees mkinitrd on rawhide installed system Aug 03 12:27
Viking-Ice_ | dont think so since I wrote and he responded to the letter on friday and he says they are making the switch together Aug 03 12:27
jlaska | Viking-Ice_: okay Aug 03 12:27
jlaska | Viking-Ice_: I'll follow-up with you later on so I can come up to speed also Aug 03 12:27
Viking-Ice_ | Ok Aug 03 12:28
jlaska | Alrighty ... let's change over to the Alpha ... Aug 03 12:28
jlaska | #topic Alpha test compose Aug 03 12:28
--- | zodbot has changed the topic to: Alpha test compose (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:28
f13 | yeah, this one is still MIA Aug 03 12:28
f13 | due to issues blocking installability Aug 03 12:28
jlaska | Looks like the udev integration was resolved late last week (thanks clumens+jeremy) Aug 03 12:28
f13 | sortof Aug 03 12:28
f13 | the patch got naked on list Aug 03 12:28
jlaska | oh? Aug 03 12:29
f13 | at least the first one did Aug 03 12:29
jlaska | on anaconda-devel-list? Aug 03 12:29
f13 | as it broke all the blacklisting of devices and such Aug 03 12:29
jlaska | so what's in rawhide now then? Aug 03 12:29
jlaska | it's working around the reported problem Aug 03 12:29
f13 | not sure. Clumens posted a patch, jeremy meh'd it in, and then bill naked it, clumens asked bill for a better patch, bill posted some suggestions, and I haven't seen any traffic regarding it since then. Aug 03 12:30
denise | I think Jeremy and clumens got one inon Friday Aug 03 12:30
* | jlaska thought so too Aug 03 12:30
denise | and basically reviewed ach other Aug 03 12:31
jlaska | Word I have from clumens is that the anaconda-12.7 build had a fix to work around the issue Aug 03 12:31
jlaska | http://git.fedorahosted.org/git/?p=anaconda.git;a=commit;h=e6402846cae226519bfc34feb4f92b40d3bf0885 Aug 03 12:31
f13 | Yeah I'm looking at commit list now and I see jeremy committed something pretty awful Aug 03 12:31
denise | see jeremy's mail to anaconda-devel "Fix up udev sillies" Aug 03 12:31
jlaska | f13: I think that unwedges the test blockers that I was aware of Aug 03 12:32
denise | f13: yeah, noone's happy about this but had to get rawhide limping Aug 03 12:32
f13 | I missed jeremy's patch on anaconda-devel-list (doesn't seem to be there) Aug 03 12:32
f13 | so I thought it was still in limbo Aug 03 12:32
Viking-Ice_ | got to run later... Aug 03 12:32
denise | f13: justthe commit mail - he had clumens review over his shoulder Aug 03 12:32
f13 | jlaska: if that's the case, I'll bank out a test compose as soon as all my freaking meetings are over. Aug 03 12:32
f13 | denise: gotcha. Aug 03 12:33
f13 | Bill is OK with this too? Aug 03 12:33
jlaska | f13: okay ... I'll update that releng ticket with bug status Aug 03 12:33
f13 | avoids the concerns he raised on list? Aug 03 12:33
denise | AFAIK Aug 03 12:33
denise | does avoid the blacklist problem Aug 03 12:33
jlaska | f13: when the compose is available, can you drop a note in that ticket and lili will commence testing Aug 03 12:33
f13 | yep Aug 03 12:33
jlaska | thanks! Aug 03 12:33
skvidal | f13: jeremy did a test compose on friday with pycurlgrabber included - and everything worked :) Aug 03 12:34
f13 | *cough* Aug 03 12:34
jlaska | Okay, so that's all I had on the Alpha test compose ... it'll be 4 days late ... but we'll get started walking the matrix now that the test blockers have been removed Aug 03 12:35
jlaska | Well, the other question I wanted to raise on this given the alpha test compose slip ... how does this impact the alpha Aug 03 12:36
jlaska | I think the best way to answer that now is that we are behind on testing media by 4 days Aug 03 12:36
jlaska | I don't think it says slip yet ... but it's a good indicator if we begin to miss other targets Aug 03 12:37
f13 | sure, now that the blockers are cleared, a walking of the matrix outside what you expect to do with media would be /really/ good Aug 03 12:37
f13 | to figure out what else is waiting for us Aug 03 12:37
jlaska | right on Aug 03 12:38
jlaska | Liam will kick that off tonight and then the fun begins! Aug 03 12:38
f13 | what's your definition of 'tonight' ? Aug 03 12:38
f13 | isn't rawhide available now for such testing? Aug 03 12:38
jlaska | indeed ... when Liam wakes up ... he'll start the ball rolling with the test matrix Aug 03 12:39
f13 | ah Aug 03 12:39
f13 | forgot what tz liam is in Aug 03 12:39
jlaska | but of course, people can download and test rawhide now ... and post results later Aug 03 12:39
jlaska | okay, if not other questions ... changing over to another Alpha topic Aug 03 12:39
jlaska | s/not/no/ Aug 03 12:40
jlaska | #topic Alpha blocker bug day#4 Aug 03 12:40
--- | zodbot has changed the topic to: Alpha blocker bug day#4 (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:40
jlaska | looking at the schedule, I don't see an alpha blocker bug day scheduled for this Friday Aug 03 12:40
jlaska | given the test compose delay, I think it might be in order and wanted to raise the topic Aug 03 12:40
* | poelcat will add one to the schedule Aug 03 12:41
jlaska | poelcat: f13: what's your take? Aug 03 12:41
f13 | My take was that releng was going to be doing one anyway to make sure we can compose the release candidate Aug 03 12:41
f13 | so doing one on friday, just to do another one on Monday I think seemed silly Aug 03 12:41
f13 | at least thats what I remember of the reasoning during our big schedule meeting Aug 03 12:41
poelcat | seems like a good idea if we are making "go/no go" following monday Aug 03 12:42
poelcat | #20 http://poelstra.fedorapeople.org/schedules/f-12/f-12-releng-tasks.html Aug 03 12:42
f13 | we would have to look at them /again/ on monday Aug 03 12:42
jlaska | yeah, what's the worst that happens Aug 03 12:42
f13 | I'm not against doing it on Friday, I just want everybody to understand that we'd be doing it on two successive work days Aug 03 12:42
poelcat | not really... if they aren't fixed or in modified then not ready? Aug 03 12:42
jlaska | there is no movement and the monday meeting is quick Aug 03 12:42
* | jlaska likes consistency ... Aug 03 12:43
poelcat | f13: so "go/no go" was really a "blocker review meeting" vs. a quick meeting to decide if ready to go or not Aug 03 12:43
* | poelcat wonders about changing task name Aug 03 12:43
poelcat | ? Aug 03 12:44
f13 | poelcat: well, in order to give a go/no go, we have to look at the blocker list Aug 03 12:44
f13 | essentially doing a blocker review Aug 03 12:44
jlaska | let's split it out Aug 03 12:44
f13 | the name may be different, but the action itself is the same Aug 03 12:44
jlaska | My preference would be to have the 2 events ... and ideally monday is quick and more of a checkpoint Aug 03 12:44
jlaska | is the list empty ... yes/no? Aug 03 12:44
f13 | look at the list, make sure all the bugs are up to date with comments, seek clarification if necessary, move things around if necessary Aug 03 12:44
poelcat | it also gives sat and sun to fix things discussed on friday Aug 03 12:45
f13 | jlaska: and if the list isn't empty, we have to review what's there to make sure we're no going on accurate information Aug 03 12:45
jlaska | f13: right on Aug 03 12:45
* | f13 plays some more pin the tail on the donkey Aug 03 12:45
jlaska | f13: I agree, I'd just like to continue the Friday trend and make sure that the bugs coming out of the compose have been reviewed and have data already Aug 03 12:46
f13 | look, I don't really care what you call it, call it whatever makes sense for ya'll. Ill just show up and do the same thing I do every other time (: Aug 03 12:46
f13 | jlaska: that's fine, do one on Friday, but don't be surprised when we do one again on Monday Aug 03 12:46
poelcat | okay, i'll add it for friday, i think we can move on Aug 03 12:46
jlaska | yes we can Aug 03 12:46
jlaska | poelcat: okay ... you want to divide and conquer for the meeting announce + summary? Aug 03 12:47
jlaska | or is there someone else who would like to? Aug 03 12:47
poelcat | jlaska: unless someone else wants to help out :) Aug 03 12:47
jlaska | poelcat: we can sign up adamw ... he's not here right now ... I'm sure he'd love to get action items Aug 03 12:48
jlaska | har har ... jk Aug 03 12:48
poelcat | jlaska: i'll do the recap Aug 03 12:48
* | poelcat finally has no conflicts on friday Aug 03 12:48
jlaska | poelcat: thx ... I'll send the announcement(s) Aug 03 12:48
jlaska | okay last planned topic for today ... Aug 03 12:48
jlaska | #topic AutoQA update from wwoods Aug 03 12:49
--- | zodbot has changed the topic to: AutoQA update from wwoods (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 12:49
jlaska | wwoods: you've got some cool updates this past week Aug 03 12:49
* | jlaska hands over the mic Aug 03 12:49
wwoods | time's kind of running together, I need to figure out what I talked about last time Aug 03 12:49
jlaska | QA/Meetings/20090727#AutoQA_update Aug 03 12:49
wwoods | okay, right. so - in the past week, I finished the final test Aug 03 12:50
wwoods | err rather - the final test of the 'installation' portion Aug 03 12:50
wwoods | which is to say that we now have a test script that Aug 03 12:50
wwoods | 1) downloads images Aug 03 12:51
wwoods | 2) starts a virt guest Aug 03 12:51
wwoods | 3) logs serial console output until loader / stage1 starts Aug 03 12:51
wwoods | 4) logs serial console output until stage2 gets loaded Aug 03 12:51
* | jlaska looks for something to wipe up drool Aug 03 12:51
wwoods | 5) downloads all anaconda logs from guest as it runs the installation Aug 03 12:51
wwoods | 6) declares success if anaconda finds and formats the disks Aug 03 12:52
wwoods | if the guest either a) goes silent for 60 seconds or more, or b) takes more than ~10 minutes without finding the disks Aug 03 12:53
poelcat | sounds rock'n to me :) Aug 03 12:53
poelcat | good job! Aug 03 12:53
wwoods | we declare failure and destroy the failed guest Aug 03 12:53
jlaska | for those interested in watching at home ... http://jlaska.fedorapeople.org/rawhide-report.png Aug 03 12:53
wwoods | failure is also declared if anaconda traces back Aug 03 12:53
jlaska | that doesn't include the install tests yet that wwoods mentioned, but gives an idea of one way that autotest can report data Aug 03 12:54
wwoods | it also records the kernel version, anaconda version, the complete list of critical path packages, etc. etc. Aug 03 12:54
wwoods | so the next obvious steps are.. make it run automatically when we get a new rawhide Aug 03 12:54
wwoods | and report those results somewhere useful Aug 03 12:54
wwoods | yeah unfortunately libvirt on ppc is... an unknown Aug 03 12:55
f13 | where are we on the less complicated tests like repoclosure and tree sanity? Aug 03 12:55
jwb | wwoods, it is? Aug 03 12:55
jlaska | wwoods: I spoke to dcantrell last week who proposed an interesting idea for a new watcher script to help out the anaconda team ... perhaps a version 2.0 feature Aug 03 12:55
wwoods | f13: tree sanity is the 'sanity' portion of the test Aug 03 12:56
wwoods | tests 1-4 on the rawhide acceptance plan Aug 03 12:56
wwoods | I'm discussing the install portion - test 5-8 Aug 03 12:56
wwoods | #link QA:Rawhide_Acceptance_Test_Plan Aug 03 12:56
wwoods | getting public reports applies equally to both parts Aug 03 12:57
wwoods | but yeah, we still have tree sanity tests running Aug 03 12:57
jlaska | f13: that screenshot I posted above is from wwoods sanity tests Aug 03 12:58
wwoods | jwb: yes. I don't know anything about how/if virt works on ppc Aug 03 12:58
jwb | wwoods, oh. that's easy. libvirt could possibly work with plain qemu, but kvm and xen and lpar doesn't work at all Aug 03 12:58
f13 | and qemu won't work for ppc Aug 03 12:59
jwb | wwoods, at least for any ppc platform that Fedora currently supports Aug 03 12:59
jlaska | jwb: interested in doing a libvirt -> hvsi layer? Aug 03 12:59
jwb | f13, no? Aug 03 12:59
f13 | there aren't open firmware emulators enough to actually boot and install ppc in qemu Aug 03 12:59
wwoods | jwb: right, so I'll need to modify code to detect the host and modify the timeout values if we're running unaccelerated full-virt guests Aug 03 12:59
f13 | there is no current way to do a Fedora ppc install in any Fedora provided virt Aug 03 12:59
jwb | f13, ah, i see what you mean. yeah, running a ppc guest in qemu is also non-interesting to fedora Aug 03 12:59
wwoods | but as f13 mentions there's not a lot of value in bothering with emulated ppc Aug 03 12:59
f13 | wwoods: it's not that there isn't value, it's that it just isn't possible to do an install Aug 03 13:00
wwoods | so probably the more useful direction would be to adapt the test to run on bare-metal instead Aug 03 13:00
jwb | jlaska, i am interested in a lot of things, but i have neither the knowledge nor the time to work on that :\ Aug 03 13:00
jlaska | jwb: ;) Aug 03 13:00
wwoods | obviously that's going to require a good bit of work, but running install tests on bare metal is a desirable goal so we'll get to that. eventually. Aug 03 13:00
wwoods | first we need to start reporting the results of the currently written tests Aug 03 13:01
wwoods | and write tests for the automateable bits of the functional tests Aug 03 13:01
wwoods | and write a frontend to allow user submission of the remaining manual parts Aug 03 13:01
wwoods | checking the roadmap.. Aug 03 13:01
wwoods | writing more tests is autoqa ticket #41-44 Aug 03 13:02
* | jlaska has no clue on #41 and #42 Aug 03 13:03
wwoods | frontend for user-submission is ticket #16-18 Aug 03 13:03
wwoods | #41 and #42 are the X startup / X input tests Aug 03 13:03
wwoods | I expect those to be user-submitted Aug 03 13:03
jlaska | ah Aug 03 13:03
wwoods | I need to add tickets for "set up watcher to run current tests" Aug 03 13:04
wwoods | and "email results to the autoqa list" Aug 03 13:04
wwoods | as a stopgap measure until we get the web bits up Aug 03 13:04
jlaska | I think that's ... https://fedorahosted.org/autoqa/ticket/45 Aug 03 13:04
jlaska | (for the watcher one I mean) Aug 03 13:04
f13 | where does the simple tests like repoclosure land in the priority list? something we could extend to not just rawhide, but updates(-testing) of previous releases too? Aug 03 13:04
wwoods | outside the scope of the current project Aug 03 13:05
f13 | ugh. Aug 03 13:05
wwoods | the milestone is israwhidebroken.com Aug 03 13:05
wwoods | the tests are defined in the test plan Aug 03 13:05
wwoods | that being said... Aug 03 13:05
wwoods | ...one of the outputs of the project is a couple of test result reporting mechanisms Aug 03 13:06
wwoods | so wiring up something like repoclosure (which jlaska has already adapted for use under autotest) Aug 03 13:06
wwoods | to the test result reporting mechanism(s) we're working on Aug 03 13:07
wwoods | will be trivial. Aug 03 13:07
wwoods | so it'll kind of just happen automatically once we have test reporting wired up Aug 03 13:07
f13 | ok. Aug 03 13:07
wwoods | so, if you want to help figuring out the test reporting bits Aug 03 13:07
wwoods | like figuring out how to get autotest sending emails Aug 03 13:08
f13 | I'm just still harping on that point. Aug 03 13:08
f13 | not really helping. Aug 03 13:08
wwoods | then we can just run the existing repoclosure test and get those emails again. Aug 03 13:08
wwoods | if that would be helpful. Aug 03 13:08
jlaska | wwoods: thanks for the update, nice work! Aug 03 13:08
f13 | unfortunately my window for helping has closed since we're at alpha freeze and my releng duties are taking all my time :/ Aug 03 13:09
jlaska | wwoods: any other upcoming plans to note ... or things you'd like contributor feedback on? Aug 03 13:09
wwoods | soon I'll probably have some docs about writing tests for autotest Aug 03 13:09
jlaska | delicious! Aug 03 13:09
wwoods | and HTML mockups (and/or mockup screenshots) of the web frontend bits Aug 03 13:10
wwoods | so I might ask for people to look over those things Aug 03 13:10
wwoods | the autotest docs are in progress already: Aug 03 13:10
wwoods | Autotest Aug 03 13:10
jlaska | heh, I'm sure those are two things people will have lots of opinions on ;) Aug 03 13:10
wwoods | (and the associated Talk: page) Aug 03 13:10
jlaska | nicely done Aug 03 13:11
wwoods | but yeah, I'll send a message or something when those are ready for further review Aug 03 13:11
--- | stickster is now known as stickster_afk Aug 03 13:11
jlaska | okay ... I unfortunately have a conflict soon ... so only short time for open discussion Aug 03 13:12
jlaska | wwoods: thanks for the good news! Aug 03 13:12
jlaska | #topic <your topic here> Aug 03 13:12
--- | zodbot has changed the topic to: <your topic here> (Meeting topic: Fedora Quality Assurance Meeting) Aug 03 13:12
jlaska | any items folks want to raise? Aug 03 13:12
* | jlaska sets the stop watch @ 5 minutes Aug 03 13:12
jlaska | okay ... if folks want to toss a topic, please follow-up to the fedora-test-list minutes Aug 03 13:16
jlaska | thanks everyone for your time Aug 03 13:16
jlaska | #endmeeting Aug 03 13:16
--- | zodbot has changed the topic to: Channel is used by various Fedora groups and committees for their regular meetings | Note that meetings often get logged | For questions about using Fedora please ask in #fedora | See http://fedoraproject.org/wiki/Meeting_channel for meeting schedule Aug 03 13:16
zodbot | Meeting ended Mon Aug 3 17:16:40 2009 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . Aug 03 13:16
zodbot | Minutes: http://meetbot.fedoraproject.org/fedora-meeting/2009-08-03/fedora-meeting.2009-08-03-16.00.html Aug 03 13:16
zodbot | Minutes (text): http://meetbot.fedoraproject.org/fedora-meeting/2009-08-03/fedora-meeting.2009-08-03-16.00.txt Aug 03 13:16
zodbot | Log: http://meetbot.fedoraproject.org/fedora-meeting/2009-08-03/fedora-meeting.2009-08-03-16.00.log.html Aug 03 13:16

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!