From Fedora Project Wiki
m (→Deliverables) |
|||
(71 intermediate revisions by 14 users not shown) | |||
Line 1: | Line 1: | ||
This is the main page for [[FAD]] Release Tools and Infrastructure 2015. This hackathon is intended to take release tools and process to the next level in Fedora for F23 and beyond. | This is the main page for [[FAD]] Release Tools and Infrastructure 2015. This hackathon is intended to take release tools and process to the next level in Fedora for F23/F24 and beyond. | ||
* Modularize the compose process | * Modularize the compose process | ||
Line 7: | Line 7: | ||
== Purpose == | == Purpose == | ||
# Our purpose is to complete the following '''primary''' goals: | # Our purpose is to complete the following '''primary''' goals: | ||
#* | #* Create repositories and workflow for code collaboration including patch review | ||
#* | #** Where will the code be stored? Where will patches and commit messages go? | ||
#* | #** Who can approve patches? How does one get commit access? (Note: This should be ''as many responsible/trusted committers as possible'', in accordance with good community practice) | ||
#* Complete any remaining architecture/design details for new release tools | |||
#** As much of this should be worked out on mailing list and IRC ''before'' the FAD as possible | |||
#** If additional VMs are needed, complete RFRs for infrastructure | |||
#* Hack (possibly fedmsg-based) framework for product compose | |||
#* (stand up VMs and/or ansible playbooks for required systems?) | |||
#* ... | |||
# In addition, we will attempt to complete the following '''secondary''' goals as time allows: | # In addition, we will attempt to complete the following '''secondary''' goals as time allows: | ||
#* | #* Early sessions on Fedora Hubs design/user stories - Thursday, [[Fedora Engineering]] team members + [[User:Decause | Remy]] | ||
#* | #* ... | ||
== | == Detailed Work Items & Final Attendees == | ||
=== Priorities === | |||
As per the [https://lists.fedoraproject.org/pipermail/rel-eng/2015-June/020298.html rel-eng FAD priority mailing list thread] | |||
{| | |||
! Priorities: Current Gen Tooling !! Task Owner !! Done | |||
|- | |||
| working pungi 4 || [[User:Maxamillion | Adam Miller]], [[User:ausil | Dennis Gilmore]], [[User:Parasense | John Disnard]], Dan Mach || [https://pagure.io/pungi/pull-request/4 Mostly done], still debugging a createrepo issue though. | |||
|- | |||
| rawhide looking like a TC/RC || [[User:Maxamillion | Adam Miller]], [[User:ausil | Dennis Gilmore ]] || Blocked on Pungi4 | |||
|- | |||
| Determine how stage koji needs to be setup/configured to be useful as a place to deploy dev versions of rel-eng tooling and then get it setup/deployed, ansiblized. || Ralph Bean || [https://lists.fedoraproject.org/pipermail/infrastructure/2015-June/016377.html DONE] [https://lists.fedoraproject.org/pipermail/buildsys/2015-June/004779.html Follow Up] | |||
|- | |||
! Prorities: Next Gen Tooling !! Task Owner !! Done | |||
|- | |||
| define what [[Compose_Database | composedb]] should be || [[User:Maxamillion | Adam Miller]], Ralph Bean || Work in progress, proposal to mailing list pending write up | |||
|- | |||
| koji 2.0 Draft document (Discussion has begun [https://lists.fedoraproject.org/pipermail/buildsys/2015-June/004763.html here]. Deliverable would be a well documented plan that can begin to be executed upon. || [[User:mikem | Mike McLean]], [[User:mikeb | Mike Bonnett]] || DONE - Awaiting proposal/writeup to [https://lists.fedorahosted.org/mailman/listinfo/koji-devel koji-devel mailing list] | |||
|- | |||
| koji [[Koji/ContentGenerators | content generators]] and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x) || [[User:mikem | Mike McLean]], [[User:mikeb | Mike Bonnett]] || DONE - Awaiting proposal/writeup to [https://lists.fedorahosted.org/mailman/listinfo/koji-devel koji-devel mailing list] - Also a lot of documentation [[Koji/ContentGenerators | here]]. | |||
|- | |||
|} | |||
=== Deliverables === | |||
{| | |||
! Nice to haves: Current Gen Tooling Deliverable !! Task Owner !! Done | |||
|- | |||
| Stage koji setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling)|| Ralph Bean || Work in Progress | |||
|- | |||
| integrated ability to make atomic installer and pxe to live in pungi || [[User:Maxamillion | Adam Miller]] || Work in Progress, currently blocked on Pungi4 | |||
|- | |||
| mash ported to createrepo_c || [[User:Ausil | Dennis Gilmore]], [[User:Parasense | Jon Disnard]], Ian Mcleod, Dan Mach || Not done at FAD, will be followed up on. | |||
|- | |||
| bodhi2 able to trigger atomic installer and pxe to live as part of the update push process. || [[User:Lmacken | Luke Macken ]] || Currently blocking on Pungi4 | |||
|- | |||
| livemedia-creator koji integration || || | |||
|- | |||
| koji able to manage the url line in kickstarts so that we can do real builds || [[User:bstinson | Brian Stinson]] || DONE [https://lists.fedorahosted.org/pipermail/koji-devel/2015-June/000026.html Patch submitted upstream] | |||
|- | |||
| run-root plugin configured || Dan Mach, Ralph Bean || [https://lists.fedorahosted.org/pipermail/koji-devel/2015-June/000026.html Patches required], [http://koji.stg.fedoraproject.org/koji/taskinfo?taskID=537343 fixed and pushed in Stage]. Ansible configs in and committed for Stage. Ralph to follow up on PROD. | |||
|- | |||
| Secondary arches working exactly the same as primary || [[User:Ausil | Dennis Gilmore]], [[User:Pbrobinson | Peter Robinson]] || | |||
|- | |||
| port pungi to dnf || Dan Mach || Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion. | |||
|- | |||
| make headway and plan to port to python 3 || Dan Mach || | |||
|- | |||
| have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22 || [[User:Mikem | Mike McLean]] || | |||
|- | |||
! Nice to haves: Next Gen Tooling Deliverable !! Task Owner !! Done | |||
|- | |||
| koji 2.0 prototype || [[User:Mikem | Mike McLean]], [[User:Mikeb | Mike Bonnett]] || | |||
|-, | |||
|} | |||
=== Attendees and Travel Details === | |||
{| | {| | ||
! Contributor !! | ! Contributor !! Arrival !! Departure !! Roommate | ||
|- | |- | ||
|[[User:Ausil| Dennis Gilmore]] || | |[[User:Ausil| Dennis Gilmore]] || Sun 2015-05-31, AA #1299, 12:02 || Mon 2015-06-08, AA #40, 19:30 || Peter Robinson | ||
|- | |- | ||
|[[User: | |[[User:pbrobinson|Peter Robinson]] || Sun 2015-05-31, VS #011, 15:25 || Mon, 2015-06-08, VS #012, 21:50 || Dennis Gilmore | ||
|- | |- | ||
|[[User: | |[[User:ralph|Ralph Bean]] || || || n/a | ||
|- | |- | ||
|[[User: | |[[User:decause|Remy DeCausemaker]] || Wed 2015-06-03, US #3916, 16:55 || Tues, 2015-06-09, US #3807, 17:20 || TBD | ||
|- | |- | ||
|[[User: | | [[User:Lmacken|Luke Macken]] || Wed 2015-06-03, JB #494, 18:47 || Tue 2015-06-09, JB #993, 19:40 || Adam Miller | ||
|- | |- | ||
|[[User: | | [[User:mikem|Mike McLean]] || Sun 2015-05-31, JB #984, 18:45 || Mon 2015-06-08, JB #1583, 18:00 || | ||
|- | |- | ||
|[[User: | | [[User:maxamillion|Adam Miller]] || Wed 2015-06-03, US #1389, 18:17 || Mon 2015-06-08, AA #1288, 12:54 || Luke Macken | ||
|- | |- | ||
|[[User: | | [[User:Wwoods|Will Woods]] || Thu 2015-06-04, DL #3504, 11:10 || Mon 2015-06-08, DL #3765, 19:30 || Ian McLeod | ||
|- | |- | ||
|[[User: | | [[User:Walters|Colin Walters]] || n/a || n/a || n/a | ||
|- | |- | ||
| [[User: | | [[User:imcleod|Ian McLeod]] || Thu 2015-06-04, AA #1240, 10:24 || Mon 2015-06-08, AA #40, 19:30 || Will Woods | ||
|- | |- | ||
|[[User: | | [[User:parasense|Jon Disnard]] || Sun 2015-05-31, AA #1429, 16:39 || Mon 2015-06-08, AA #1178, 16:16 || TBD | ||
|- | |||
| [[User:Lkocman|Luboš Kočman]] || Sun 2015-05-31, AA #6227, 18:55 || Mon 2015-06-08, AA #6163, 19:10 || Daniel Mach | |||
|- | |||
| [[User:bstinson|Brian Stinson]] || Thu 2015-06-04, US #1299, 12:05 || Mon 2015-06-08, US #197, 17:35 || | |||
|- | |||
! colspan=4 | Remote attendees | |||
|- | |||
| colspan=4 | [[User:sharkcz|Dan Horak]] (TBD) | |||
|} | |} | ||
<!-- | |||
== Planning Prerequisites == | == Planning Prerequisites == | ||
Line 51: | Line 120: | ||
See the [[How to organize a FAD]] list; you can keep your to-do list here. | See the [[How to organize a FAD]] list; you can keep your to-do list here. | ||
* Work out budget | * <strike>Work out budget</strike> | ||
* Decide on Dates and Location | * <strike>Decide on Dates and Location</strike> | ||
* Arrange Facilities | * <strike>Arrange Facilities</strike> | ||
* List Resources | * <strike>List Resources</strike> | ||
* Be Somewhat Structured | * <strike>Be Somewhat Structured</strike> | ||
* Arrange Lodging | * <strike>Arrange Lodging</strike> | ||
* Arrange Refreshments | * Arrange Refreshments | ||
* Arrange a Social Event | * Arrange a Social Event | ||
--> | |||
== Plan == | == Plan == | ||
# '''Location: | # '''Location:''' Red Hat, Westford, MA USA | ||
# '''Date:''' | # '''Date:''' Jun-04 to Jun-08 | ||
#* Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor) | |||
#* | #* Jun-05 -- 09:00am - 6:00pm - Waterford Valley CR (1st floor) | ||
#* Jun-06 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor) | |||
#* | #* Jun-07 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor) | ||
#* | #* Jun-08 -- departure date | ||
#* | # '''Remote Attendees:''' https://redhat.bluejeans.com/4332589184 | ||
#* | |||
# | |||
# '''Schedule''' | # '''Schedule''' | ||
#* | #* Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session) | ||
#* | #* Non-Fedora Engineering team domestic participants arrive Thu before | ||
#* Fri -- Work day | #* Fri -- Work day | ||
#* Sat -- Work day | #* Sat -- Work day | ||
#* Sun -- Work day | #* Sun -- Work day | ||
#* Participants leave Mon (or Sunday night if required) | #* Participants leave Mon (or Sunday night if required) | ||
== Logistics == | == Logistics == | ||
'''Snacks/Beverages:''' Can be snarfed from | '''Snacks/Beverages:''' Can be snarfed from Westford office | ||
'''Breakfast:''' | '''Breakfast:''' | ||
* | * Covered at hotel | ||
'''Lunch:''' | '''Lunch:''' | ||
* Days other than Fri/Sat/Sun to be covered by attendees. | * Days other than Thu/Fri/Sat/Sun to be covered by attendees. | ||
* Fri: | * Thu: Order in, cost covered (est. $125) | ||
* Sat: Order in, cost covered (est. $ | * Fri: Order in, cost covered (est. $125) | ||
* Sun: Order in, cost covered (est. $ | * Sat: Order in, cost covered (est. $125) | ||
* Sun: Order in, cost covered (est. $125) | |||
'''Dinner:''' | '''Dinner:''' | ||
* Days other than Thu/Fri/Sat/Sun to be covered by attendees | * Days other than Thu/Fri/Sat/Sun to be covered by attendees | ||
* Thu: ad-hoc | * Thu: ad-hoc | ||
* Fri: | * Fri: Team @ local venue (est. $300) | ||
* Sat: | * Sat: Team @ local venue (est. $300) | ||
* Sun: | * Sun: Team @ local venue (est. $300) | ||
'''Total food: est. $1400''' | |||
== Travel estimates == | == Travel estimates == | ||
{| | {| | ||
! Contributor !! Taxi/transport (to/from home) !! Airfare !! Taxi/transport (to/from site) !! Parking !! Other | ! Contributor !! Taxi/transport (to/from home) !! Airfare !! Taxi/transport (to/from site) !! Parking !! Other | ||
|- | |||
| Dennis Gilmore || - || - || - || - || covered by RCM | |||
|- | |||
| Peter Robinson || - || - || - || - || covered by RCM | |||
|- | |||
| Ralph Bean || || $100 (gas) || || $ 50 || (parking from F-Eng budget) | |||
|- | |||
| Daniel Mach || - || - || - || - || covered by RCM | |||
|- | |||
| Luke Macken || || $390 || || $ 50 || (parking from F-Eng budget) | |||
|- | |||
| Mike McLean || - || - || - || - || covered by RCM | |||
|- | |||
| Adam Miller || || $225 || || $ 50 || (parking from F-Eng budget) | |||
|- | |||
| Will Woods || || $210 || || $ 50 || (parking from Anaconda or F-Eng budget) | |||
|- | |- | ||
| | | Ian McLeod || || $250 || || $ 50 || | ||
|- | |||
| Jon Disnard || - || - || - || - || covered by RCM | |||
|} | |} | ||
# '''Travel:''' | # '''Travel:''' $500 rental minivan + $1175 above = $1675 | ||
# '''Housing:''' | # '''Housing:''' $1185 | ||
#* | #* Hampton Inn Westford/Chelmsford, <http://ur1.ca/ka20d> -- $117/night | ||
#** for FAD budget: 1 room 4 nights, 1 room 5 nights = 9 nights + tax = ~$1185 | |||
#* | #* Ralph Bean: $65 * 5 nights = $325 | ||
# '''Space:''' | # '''Space:''' | ||
#* $0 if Supplied by Red Hat | #* $0 if Supplied by Red Hat | ||
# '''Supplies:''' | # '''Supplies:''' | ||
#* N/A | #* N/A | ||
# '''Food:''' $1400 (from above) | |||
''Total budget: $4,585'' | |||
[[Category:FAD]] | [[Category:FAD]] |
Latest revision as of 17:57, 12 June 2015
This is the main page for FAD Release Tools and Infrastructure 2015. This hackathon is intended to take release tools and process to the next level in Fedora for F23/F24 and beyond.
- Modularize the compose process
- Replace serial bash script with easier to hack and maintain Python tools
- Establish dependency management of compose deliverables
- Cut time to provide updates to users for critical security fixes
Purpose
- Our purpose is to complete the following primary goals:
- Create repositories and workflow for code collaboration including patch review
- Where will the code be stored? Where will patches and commit messages go?
- Who can approve patches? How does one get commit access? (Note: This should be as many responsible/trusted committers as possible, in accordance with good community practice)
- Complete any remaining architecture/design details for new release tools
- As much of this should be worked out on mailing list and IRC before the FAD as possible
- If additional VMs are needed, complete RFRs for infrastructure
- Hack (possibly fedmsg-based) framework for product compose
- (stand up VMs and/or ansible playbooks for required systems?)
- ...
- Create repositories and workflow for code collaboration including patch review
- In addition, we will attempt to complete the following secondary goals as time allows:
- Early sessions on Fedora Hubs design/user stories - Thursday, Fedora Engineering team members + Remy
- ...
Detailed Work Items & Final Attendees
Priorities
As per the rel-eng FAD priority mailing list thread
Priorities: Current Gen Tooling | Task Owner | Done |
---|---|---|
working pungi 4 | Adam Miller, Dennis Gilmore, John Disnard, Dan Mach | Mostly done, still debugging a createrepo issue though. |
rawhide looking like a TC/RC | Adam Miller, Dennis Gilmore | Blocked on Pungi4 |
Determine how stage koji needs to be setup/configured to be useful as a place to deploy dev versions of rel-eng tooling and then get it setup/deployed, ansiblized. | Ralph Bean | DONE Follow Up |
Prorities: Next Gen Tooling | Task Owner | Done |
define what composedb should be | Adam Miller, Ralph Bean | Work in progress, proposal to mailing list pending write up |
koji 2.0 Draft document (Discussion has begun here. Deliverable would be a well documented plan that can begin to be executed upon. | Mike McLean, Mike Bonnett | DONE - Awaiting proposal/writeup to koji-devel mailing list |
koji content generators and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x) | Mike McLean, Mike Bonnett | DONE - Awaiting proposal/writeup to koji-devel mailing list - Also a lot of documentation here. |
Deliverables
Nice to haves: Current Gen Tooling Deliverable | Task Owner | Done |
---|---|---|
Stage koji setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling) | Ralph Bean | Work in Progress |
integrated ability to make atomic installer and pxe to live in pungi | Adam Miller | Work in Progress, currently blocked on Pungi4 |
mash ported to createrepo_c | Dennis Gilmore, Jon Disnard, Ian Mcleod, Dan Mach | Not done at FAD, will be followed up on. |
bodhi2 able to trigger atomic installer and pxe to live as part of the update push process. | Luke Macken | Currently blocking on Pungi4 |
livemedia-creator koji integration | ||
koji able to manage the url line in kickstarts so that we can do real builds | Brian Stinson | DONE Patch submitted upstream |
run-root plugin configured | Dan Mach, Ralph Bean | Patches required, fixed and pushed in Stage. Ansible configs in and committed for Stage. Ralph to follow up on PROD. |
Secondary arches working exactly the same as primary | Dennis Gilmore, Peter Robinson | |
port pungi to dnf | Dan Mach | Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion. |
make headway and plan to port to python 3 | Dan Mach | |
have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22 | Mike McLean | |
Nice to haves: Next Gen Tooling Deliverable | Task Owner | Done |
koji 2.0 prototype | Mike McLean, Mike Bonnett |
Attendees and Travel Details
Contributor | Arrival | Departure | Roommate |
---|---|---|---|
Dennis Gilmore | Sun 2015-05-31, AA #1299, 12:02 | Mon 2015-06-08, AA #40, 19:30 | Peter Robinson |
Peter Robinson | Sun 2015-05-31, VS #011, 15:25 | Mon, 2015-06-08, VS #012, 21:50 | Dennis Gilmore |
Ralph Bean | n/a | ||
Remy DeCausemaker | Wed 2015-06-03, US #3916, 16:55 | Tues, 2015-06-09, US #3807, 17:20 | TBD |
Luke Macken | Wed 2015-06-03, JB #494, 18:47 | Tue 2015-06-09, JB #993, 19:40 | Adam Miller |
Mike McLean | Sun 2015-05-31, JB #984, 18:45 | Mon 2015-06-08, JB #1583, 18:00 | |
Adam Miller | Wed 2015-06-03, US #1389, 18:17 | Mon 2015-06-08, AA #1288, 12:54 | Luke Macken |
Will Woods | Thu 2015-06-04, DL #3504, 11:10 | Mon 2015-06-08, DL #3765, 19:30 | Ian McLeod |
Colin Walters | n/a | n/a | n/a |
Ian McLeod | Thu 2015-06-04, AA #1240, 10:24 | Mon 2015-06-08, AA #40, 19:30 | Will Woods |
Jon Disnard | Sun 2015-05-31, AA #1429, 16:39 | Mon 2015-06-08, AA #1178, 16:16 | TBD |
Luboš Kočman | Sun 2015-05-31, AA #6227, 18:55 | Mon 2015-06-08, AA #6163, 19:10 | Daniel Mach |
Brian Stinson | Thu 2015-06-04, US #1299, 12:05 | Mon 2015-06-08, US #197, 17:35 | |
Remote attendees | |||
Dan Horak (TBD) |
Plan
- Location: Red Hat, Westford, MA USA
- Date: Jun-04 to Jun-08
- Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor)
- Jun-05 -- 09:00am - 6:00pm - Waterford Valley CR (1st floor)
- Jun-06 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
- Jun-07 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
- Jun-08 -- departure date
- Remote Attendees: https://redhat.bluejeans.com/4332589184
- Schedule
- Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
- Non-Fedora Engineering team domestic participants arrive Thu before
- Fri -- Work day
- Sat -- Work day
- Sun -- Work day
- Participants leave Mon (or Sunday night if required)
Logistics
Snacks/Beverages: Can be snarfed from Westford office
Breakfast:
- Covered at hotel
Lunch:
- Days other than Thu/Fri/Sat/Sun to be covered by attendees.
- Thu: Order in, cost covered (est. $125)
- Fri: Order in, cost covered (est. $125)
- Sat: Order in, cost covered (est. $125)
- Sun: Order in, cost covered (est. $125)
Dinner:
- Days other than Thu/Fri/Sat/Sun to be covered by attendees
- Thu: ad-hoc
- Fri: Team @ local venue (est. $300)
- Sat: Team @ local venue (est. $300)
- Sun: Team @ local venue (est. $300)
Total food: est. $1400
Travel estimates
Contributor | Taxi/transport (to/from home) | Airfare | Taxi/transport (to/from site) | Parking | Other |
---|---|---|---|---|---|
Dennis Gilmore | - | - | - | - | covered by RCM |
Peter Robinson | - | - | - | - | covered by RCM |
Ralph Bean | $100 (gas) | $ 50 | (parking from F-Eng budget) | ||
Daniel Mach | - | - | - | - | covered by RCM |
Luke Macken | $390 | $ 50 | (parking from F-Eng budget) | ||
Mike McLean | - | - | - | - | covered by RCM |
Adam Miller | $225 | $ 50 | (parking from F-Eng budget) | ||
Will Woods | $210 | $ 50 | (parking from Anaconda or F-Eng budget) | ||
Ian McLeod | $250 | $ 50 | |||
Jon Disnard | - | - | - | - | covered by RCM |
- Travel: $500 rental minivan + $1175 above = $1675
- Housing: $1185
- Hampton Inn Westford/Chelmsford, <http://ur1.ca/ka20d> -- $117/night
- for FAD budget: 1 room 4 nights, 1 room 5 nights = 9 nights + tax = ~$1185
- Ralph Bean: $65 * 5 nights = $325
- Hampton Inn Westford/Chelmsford, <http://ur1.ca/ka20d> -- $117/night
- Space:
- $0 if Supplied by Red Hat
- Supplies:
- N/A
- Food: $1400 (from above)
Total budget: $4,585