From Fedora Project Wiki
Line 64: | Line 64: | ||
* Send a reminder to devel-announce to have packages in ''rawhide'' for upcoming compose | * Send a reminder to devel-announce to have packages in ''rawhide'' for upcoming compose | ||
* Build up the Release Engineering team so that alternate team members can compose releases | * Build up the Release Engineering team so that alternate team members can compose releases | ||
|| | |||
* Added specific tasks to the development schedule reminding of need for latest installter build | |||
* Continue deepening Release Engineering SOPs | |||
|- | |- | ||
| Create Installable Images for QA testing #3 || 2010-07-22 || | | Create Installable Images for QA testing #3 || 2010-07-22 || | ||
Line 83: | Line 86: | ||
** stream audio to the web | ** stream audio to the web | ||
** people without the ability to connect to Fedora Talk can listen to web stream and respond in IRC | ** people without the ability to connect to Fedora Talk can listen to web stream and respond in IRC | ||
|| Continue to look for ways to streamline meetings. By the end of the release cycle the current approach seemed to still be the best, though not perfect. | |||
|- | |- | ||
| Branch Fedora 14 || 2010-07-27 || | | Branch Fedora 14 || 2010-07-27 || | ||
Line 100: | Line 104: | ||
* Could we do any sanity testing before publishing images to make sure they boot to save bandwidth and turn around time? In the case of Test Compose #1 it fell over right way. | * Could we do any sanity testing before publishing images to make sure they boot to save bandwidth and turn around time? In the case of Test Compose #1 it fell over right way. | ||
* Kevin Kofler suggests it may ultimately have worked out better simply to delay the Alpha freeze and leave dist-f14 tag open until the major problems were resolved | * Kevin Kofler suggests it may ultimately have worked out better simply to delay the Alpha freeze and leave dist-f14 tag open until the major problems were resolved | ||
|| | |||
* TBD | |||
|- | |- | ||
|| Feature Submission Deadline || 2010-07-13 || | || Feature Submission Deadline || 2010-07-13 || | ||
Line 105: | Line 111: | ||
* Seems that spin deadline could be later, there is so much other stuff eg even the main Fedora gnome/kde spins to test. (The current spins wrangler disagrees.) | * Seems that spin deadline could be later, there is so much other stuff eg even the main Fedora gnome/kde spins to test. (The current spins wrangler disagrees.) | ||
|| | || | ||
* Concentrate on one spin successful booting | * Concentrate on one spin successful booting (what does this mean? [[User:Poelstra|poelcat]] 20:53, 23 November 2010 (UTC)) | ||
* Set a slightly or much later spin completion date | * Set a slightly or much later spin completion date (what completion date? [[User:Poelstra|poelcat]] 20:53, 23 November 2010 (UTC)) | ||
|| | |||
* TBD | |||
* Need more information from Spins SIG to clarify above questions and also need to know how they would like the schedule to be set for Fedora 15 | |||
|- | |- | ||
|| Nightly Spin composes || 2010-07-* || | || Nightly Spin composes || 2010-07-* || | ||
Line 112: | Line 121: | ||
|| | || | ||
* Get features that impact lots of other packages (or testing thereof) in well before the deadline. | * Get features that impact lots of other packages (or testing thereof) in well before the deadline. | ||
|| | |||
* Discuss with FESCo to see if there is anything that could be pursued here. | |||
|- | |- | ||
|| Nightly Spin ISOs for Alpha || 2010-08-24 || | || Nightly Spin ISOs for Alpha || 2010-08-24 || | ||
Line 117: | Line 128: | ||
|| | || | ||
* Don't let updates with dependency issues into stable. | * Don't let updates with dependency issues into stable. | ||
|| Investigate current policy around dependency issues in stable and discuss policy changes (if applicable) with FESCo. | |||
|- | |- | ||
|| Notify mirrors about new release content || 2010-08-23 || | || Notify mirrors about new release content || 2010-08-23 || | ||
Line 125: | Line 137: | ||
* Include a task on the schedule going forward to include making this announcement. | * Include a task on the schedule going forward to include making this announcement. | ||
* Include the actual procedure in the automatically filed rel-eng Trac ticket for releases. | * Include the actual procedure in the automatically filed rel-eng Trac ticket for releases. | ||
|| | |||
* Update schedule to include announcment on Friday following, Thursday "sync to mirrors." | |||
* Coordinate writing of SOP with Release Engineering | |||
|- | |- | ||
|| Web content change for F14 Alpha || 2010-08-24 || | || Web content change for F14 Alpha || 2010-08-24 || | ||
Line 131: | Line 146: | ||
* [[Fedora Websites Release SOP]] should include info on naming, preferably point to the Release Engineering SOP for creating the ISOs we ship | * [[Fedora Websites Release SOP]] should include info on naming, preferably point to the Release Engineering SOP for creating the ISOs we ship | ||
* Release Engineering needs an SOP for creating the content (including standard naming) | * Release Engineering needs an SOP for creating the content (including standard naming) | ||
|| | |||
* Work with Websites team to clarify SOP | |||
* Work with Release Engineering team to create SOP | |||
|- | |- | ||
|| Meeting times || 2010-08-31 || | || Meeting times || 2010-08-31 || | ||
Line 136: | Line 154: | ||
|| | || | ||
* If possible include the time of meetings in the ical schedule - so they appear at right time/date in calendars. | * If possible include the time of meetings in the ical schedule - so they appear at right time/date in calendars. | ||
|| | |||
* Add UTC time to schedule task descriptions. | |||
* Note: unfortunately there are some bugs in TaskJuggler that make it difficult/impossible to add specific times to the ical file--this is why all ical entries are "full day" events, agree this is not ideal. [[User:Poelstra|poelcat]] 20:53, 23 November 2010 (UTC) | |||
|- | |- | ||
| Compose Beta RC || 2010-09-16 || RC compose was not ready until the end of 2010-09-17 because of two un-resolved blocker bugs (anaconda and kernel). Both bugs had been open for several days. || Determine if one week is really enough time from the creation of the ''Test Compose'' and and the compose of the ''Release Candidate''. During this one week period we are supposed to test the Test Compose, identify bugs, and fix all blocker bugs, so the compose of the ''Release Candidate'' can begin. | | Compose Beta RC || 2010-09-16 || RC compose was not ready until the end of 2010-09-17 because of two un-resolved blocker bugs (anaconda and kernel). Both bugs had been open for several days. || Determine if one week is really enough time from the creation of the ''Test Compose'' and and the compose of the ''Release Candidate''. During this one week period we are supposed to test the Test Compose, identify bugs, and fix all blocker bugs, so the compose of the ''Release Candidate'' can begin. | ||
|| Pulled Test Compose in by two days--instead of starting on Thursday, have Release Engineering create two days earlier (Tuesday). The result is that testing will happen earlier too. [[User:Poelstra|poelcat]] 20:53, 23 November 2010 (UTC) | |||
|- | |- | ||
| Building new spin-kickstart packages || 2010-10-12 || With the new updates policy we can't get the updated package into stable on freeze day unless we have more lead time. || Since there is already a plan to do an update if there is any change during the freeze, it isn't a big deal to do the package builds 8 days earlier. The branch before the GA freeze should stay aligned with that package build and also move 8 days earlier. (After looking more closely the spin freeze is 7 days before the final change deadline and maybe we don't need a full 8 days more.) | | Building new spin-kickstart packages || 2010-10-12 || With the new updates policy we can't get the updated package into stable on freeze day unless we have more lead time. || Since there is already a plan to do an update if there is any change during the freeze, it isn't a big deal to do the package builds 8 days earlier. The branch before the GA freeze should stay aligned with that package build and also move 8 days earlier. (After looking more closely the spin freeze is 7 days before the final change deadline and maybe we don't need a full 8 days more.) |
Revision as of 20:53, 23 November 2010
Background
Largely inspired by the success Fedora 13 QA Retrospecitve and the benefit of capturing data from ideas and events when they happen, this page is for tracking Fedora 14 schedule successes and mis-steps. It's goal is iteratively track and refine our process of testing and releasing Fedora 14 on time.
Any Fedora team member or community observer is welcome to add information here.
Successes
Task | Date | What was successful? | How to Repeat It? |
---|---|---|---|
Pre-Alpha Rawhide Acceptance Test Plan #1 | 2010-07-12 | Anaconda traces back on install. The success here is that we discovered this problem four weeks before the Alpha Compose | Keep doing what we are doing |
Pre-Alpha blocker bug meetings | 2010-07-24 | Meetings are happening each week and people are referencing the release criteria in the bugs--this is helping to save time at the review meetings |
|
Compose Alpha Release Candidate | 2010-08-05 |
|
|
Tracking release blockers | 2010-08-05 |
|
|
Beta Test Compose | 2010-09-09 | Completed on schedule |
|
Tracking Compose Details | 2010-09-14 | We are tracking more and more detail in the release engineering tickets for each official compose, in particular which packages must be in as demonsrated in this ticket. This makes the process more transparent and allows more eyes on the details increasing the chances of getting things right the first time. | Continue to track important package details and instructions for the compose in the Trac ticket. |
Blocker Bug Meetings | 2010-09-14 | Holding weekly blocker bug meetings each Friday and monitoring the the blocker bug list closely and having an additional ad-hoc meeting on the Tuesday before the Thursday RC Compose to make sure everything was moving in the right direction. | More of the same |
Public Release of Beta | 2010-09-28 | The Fedora 14 Beta was released on scheduled | We barely made. Continued diligent review of and fixing blocker bugs in a timely manner |
Keeping track of spins' status | 2010-10-12 | The nightly spin composes make it easy to check that spins are building and are properly sized. When problems are noticed, there is history to help track down what broke things. | Keep doing the nightly spin composes |
Final Release | 2010-11-02 | Released on time! | Making Final Change Deadline on Monday followed by a couple of days to get a solid RC before handing off to QA for testing on Thursday helped. This did short QA by one over their usual test cycle. |
Could Have Been Better
Task | Date | What Happened? | What To Do Differently Next Time? | Actions Taken |
---|---|---|---|---|
Create Installable Images for QA testing #1 | 2010-07-08 |
|
|
|
Create Installable Images for QA testing #3 | 2010-07-22 |
|
|
Keep in mind for the future. |
Fedora 14 Blocker Meetings are already taking a minimum of an hour | 2010-07-24 |
|
|
Continue to look for ways to streamline meetings. By the end of the release cycle the current approach seemed to still be the best, though not perfect. |
Branch Fedora 14 | 2010-07-27 |
|
| |
Fedora 14 Alpha Test Compose | 2010-07-29 |
|
|
|
Feature Submission Deadline | 2010-07-13 |
|
| |
Nightly Spin composes | 2010-07-* |
|
|
|
Nightly Spin ISOs for Alpha | 2010-08-24 |
|
|
Investigate current policy around dependency issues in stable and discuss policy changes (if applicable) with FESCo. |
Notify mirrors about new release content | 2010-08-23 |
|
|
|
Web content change for F14 Alpha | 2010-08-24 |
|
|
|
Meeting times | 2010-08-31 |
|
|
|
Compose Beta RC | 2010-09-16 | RC compose was not ready until the end of 2010-09-17 because of two un-resolved blocker bugs (anaconda and kernel). Both bugs had been open for several days. | Determine if one week is really enough time from the creation of the Test Compose and and the compose of the Release Candidate. During this one week period we are supposed to test the Test Compose, identify bugs, and fix all blocker bugs, so the compose of the Release Candidate can begin. | Pulled Test Compose in by two days--instead of starting on Thursday, have Release Engineering create two days earlier (Tuesday). The result is that testing will happen earlier too. poelcat 20:53, 23 November 2010 (UTC) |
Building new spin-kickstart packages | 2010-10-12 | With the new updates policy we can't get the updated package into stable on freeze day unless we have more lead time. | Since there is already a plan to do an update if there is any change during the freeze, it isn't a big deal to do the package builds 8 days earlier. The branch before the GA freeze should stay aligned with that package build and also move 8 days earlier. (After looking more closely the spin freeze is 7 days before the final change deadline and maybe we don't need a full 8 days more.) | |
Testing live spins | 2010-10-22 | While I (bruno) didn't get some stuff done in time this time around, trying to go through test cases at the RC phase is too late. | If we do spins the same for F15, we need to have the mandatory testing to be done by spin owners sync'd up with the TC phase, so that we have time to react. | |
Final Release Readiness Meeting | 2010-10-18 | Key team leads did not attend or came very late: Design, Release Engineering, Infrastructure, and Websites. | ||
New FI task: Hide -Alpha and -Beta releases | 2010-11-02 | MirrorManager task to hide version-Alpha and -Beta from the mirror lists on release day |