From Fedora Project Wiki
 
(12 intermediate revisions by 4 users not shown)
Line 7: Line 7:


== Purpose ==
== Purpose ==
{{admon/important| Technical goals TBD | There are [[#Deliverables|Deliverables]] listed below that should be prioritized and collated with this list.}}
# Our purpose is to complete the following '''primary''' goals:
# Our purpose is to complete the following '''primary''' goals:
#* Create repositories and workflow for code collaboration including patch review
#* Create repositories and workflow for code collaboration including patch review
Line 24: Line 23:
== Detailed Work Items & Final Attendees ==
== Detailed Work Items & Final Attendees ==


=== Deliverables ===
=== Priorities ===
{{admon/important|This list needs to be prioritized by the principals involved.}}
 
As per the [https://lists.fedoraproject.org/pipermail/rel-eng/2015-June/020298.html rel-eng FAD priority mailing list thread]
 
{|
{|
! Current Gen Tooling Deliverable !! Task Owner !! Done  
! Priorities: Current Gen Tooling !! Task Owner !! Done  
|-
| working pungi 4 || [[User:Maxamillion | Adam Miller]], [[User:ausil | Dennis Gilmore]], [[User:Parasense | John Disnard]], Dan Mach || [https://pagure.io/pungi/pull-request/4 Mostly done], still debugging a createrepo issue though.
|-
|-
| Figure out what stage koji needs to be and then get it setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling)|| ||
| rawhide looking like a TC/RC || [[User:Maxamillion | Adam Miller]], [[User:ausil | Dennis Gilmore ]] || Blocked on Pungi4
|-
|-
| working pungi 4 || ||
| Determine how stage koji needs to be setup/configured to be useful as a place to deploy dev versions of rel-eng tooling and then get it setup/deployed, ansiblized. || Ralph Bean || [https://lists.fedoraproject.org/pipermail/infrastructure/2015-June/016377.html DONE] [https://lists.fedoraproject.org/pipermail/buildsys/2015-June/004779.html Follow Up]
|-
|-
| integrated ability to make atomic installer and pxe to live in pungi || ||
! Prorities: Next Gen Tooling !! Task Owner !! Done
|-
|-
| mash ported to createrepo_c || ||
| define what [[Compose_Database | composedb]] should be || [[User:Maxamillion | Adam Miller]], Ralph Bean || Work in progress, proposal to mailing list pending write up
|-
|-
| rawhide looking like a TC/RC || ||
| koji 2.0 Draft document (Discussion has begun [https://lists.fedoraproject.org/pipermail/buildsys/2015-June/004763.html here]. Deliverable would be a well documented plan that can begin to be executed upon. || [[User:mikem | Mike McLean]], [[User:mikeb | Mike Bonnett]] || DONE - Awaiting proposal/writeup to [https://lists.fedorahosted.org/mailman/listinfo/koji-devel koji-devel mailing list]
|-
|-
| bodhi2 able to trigger atomic installer and pxe to live as part of the update push process. || ||
| koji [[Koji/ContentGenerators | content generators]] and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x) || [[User:mikem | Mike McLean]], [[User:mikeb | Mike Bonnett]] || DONE - Awaiting proposal/writeup to [https://lists.fedorahosted.org/mailman/listinfo/koji-devel koji-devel mailing list] - Also a lot of documentation [[Koji/ContentGenerators | here]].
|-
|}
 
=== Deliverables ===
 
{|
! Nice to haves: Current Gen Tooling Deliverable !! Task Owner !! Done
|-
|-
| livemedia-creator koji integration || ||
| Stage koji setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling)|| Ralph Bean || Work in Progress
|-
|-
| koji able to manage the url line in kickstarts so that we can do real builds || ||
| integrated ability to make atomic installer and pxe to live in pungi || [[User:Maxamillion | Adam Miller]] || Work in Progress, currently blocked on Pungi4
|-
|-
| run-root plugin configured || ||
| mash ported to createrepo_c || [[User:Ausil | Dennis Gilmore]], [[User:Parasense | Jon Disnard]], Ian Mcleod, Dan Mach || Not done at FAD, will be followed up on.
|-
|-
| Secondary arches working exactly teh same as primary || ||
| bodhi2 able to trigger atomic installer and pxe to live as part of the update push process. || [[User:Lmacken | Luke Macken ]] || Currently blocking on Pungi4
|-
|-
| port pungi to dnf || ||
| livemedia-creator koji integration || ||
|-
|-
| make headway and plan to port to python 3 || ||
| koji able to manage the url line in kickstarts so that we can do real builds || [[User:bstinson | Brian Stinson]] || DONE [https://lists.fedorahosted.org/pipermail/koji-devel/2015-June/000026.html Patch submitted upstream]
|-
|-
| have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22 || ||
| run-root plugin configured || Dan Mach, Ralph Bean || [https://lists.fedorahosted.org/pipermail/koji-devel/2015-June/000026.html Patches required], [http://koji.stg.fedoraproject.org/koji/taskinfo?taskID=537343 fixed and pushed in Stage]. Ansible configs in and committed for Stage. Ralph to follow up on PROD.
|-
|-
! Next Gen Tooling Deliverable !! Task Owner !! Done
| Secondary arches working exactly the same as primary || [[User:Ausil | Dennis Gilmore]], [[User:Pbrobinson | Peter Robinson]] ||
|-
|-
| define what composedb should be || ||
| port pungi to dnf || Dan Mach || Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion.
|-
|-
| koji 2.0 Draft document || ||
| make headway and plan to port to python 3 || Dan Mach ||  
|-
|-
| koji 2.0 prototype || ||
| have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22 || [[User:Mikem | Mike McLean]] ||
|-
|-
| koji [[Koji/ContentGenerators | content generators]] and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x) || ||
! Nice to haves: Next Gen Tooling Deliverable !! Task Owner !! Done
|-
|-
| koji 2.0 prototype || [[User:Mikem | Mike McLean]], [[User:Mikeb | Mike Bonnett]] ||
|-,
|}
|}


Line 77: Line 89:
|[[User:ralph|Ralph Bean]] ||  ||  || n/a
|[[User:ralph|Ralph Bean]] ||  ||  || n/a
|-
|-
|[[User:decause|Remy DeCausemaker]] || ||  || TBD
|[[User:decause|Remy DeCausemaker]] || Wed 2015-06-03, US #3916, 16:55 || Tues, 2015-06-09, US #3807, 17:20 || TBD
|-
|-
| [[User:Lmacken|Luke Macken]] || Wed 2015-06-03, JB #494, 18:47 || Tue 2015-06-09, JB #993, 19:40 || Adam Miller
| [[User:Lmacken|Luke Macken]] || Wed 2015-06-03, JB #494, 18:47 || Tue 2015-06-09, JB #993, 19:40 || Adam Miller
Line 123: Line 135:
# '''Date:''' Jun-04 to Jun-08
# '''Date:''' Jun-04 to Jun-08
#* Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor)
#* Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor)
#* Jun-05 to Jun-07 -- FAD (for all) -- in Waterford Valley CR (1st floor)
#* Jun-05 -- 09:00am - 6:00pm - Waterford Valley CR (1st floor)
#* Jun-06 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
#* Jun-07 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
#* Jun-08 -- departure date
#* Jun-08 -- departure date
#* Considerations:
# '''Remote Attendees:''' https://redhat.bluejeans.com/4332589184
# '''Schedule'''
# '''Schedule'''
#* Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
#* Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
Line 133: Line 147:
#* Sun -- Work day
#* Sun -- Work day
#* Participants leave Mon (or Sunday night if required)
#* Participants leave Mon (or Sunday night if required)
# Important skills
#* Python (vital!)
#* bash
#* understanding of release deliverables
#* knowledge of fedmsg and other backend technologies helpful
#* knowledge of Koji processes and internals helpful
#* Will Woods from Anaconda team


== Logistics ==
== Logistics ==

Latest revision as of 17:57, 12 June 2015

This is the main page for FAD Release Tools and Infrastructure 2015. This hackathon is intended to take release tools and process to the next level in Fedora for F23/F24 and beyond.

  • Modularize the compose process
  • Replace serial bash script with easier to hack and maintain Python tools
  • Establish dependency management of compose deliverables
  • Cut time to provide updates to users for critical security fixes

Purpose

  1. Our purpose is to complete the following primary goals:
    • Create repositories and workflow for code collaboration including patch review
      • Where will the code be stored? Where will patches and commit messages go?
      • Who can approve patches? How does one get commit access? (Note: This should be as many responsible/trusted committers as possible, in accordance with good community practice)
    • Complete any remaining architecture/design details for new release tools
      • As much of this should be worked out on mailing list and IRC before the FAD as possible
      • If additional VMs are needed, complete RFRs for infrastructure
    • Hack (possibly fedmsg-based) framework for product compose
    • (stand up VMs and/or ansible playbooks for required systems?)
    • ...
  2. In addition, we will attempt to complete the following secondary goals as time allows:

Detailed Work Items & Final Attendees

Priorities

As per the rel-eng FAD priority mailing list thread

Priorities: Current Gen Tooling Task Owner Done
working pungi 4 Adam Miller, Dennis Gilmore, John Disnard, Dan Mach Mostly done, still debugging a createrepo issue though.
rawhide looking like a TC/RC Adam Miller, Dennis Gilmore Blocked on Pungi4
Determine how stage koji needs to be setup/configured to be useful as a place to deploy dev versions of rel-eng tooling and then get it setup/deployed, ansiblized. Ralph Bean DONE Follow Up
Prorities: Next Gen Tooling Task Owner Done
define what composedb should be Adam Miller, Ralph Bean Work in progress, proposal to mailing list pending write up
koji 2.0 Draft document (Discussion has begun here. Deliverable would be a well documented plan that can begin to be executed upon. Mike McLean, Mike Bonnett DONE - Awaiting proposal/writeup to koji-devel mailing list
koji content generators and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x) Mike McLean, Mike Bonnett DONE - Awaiting proposal/writeup to koji-devel mailing list - Also a lot of documentation here.

Deliverables

Nice to haves: Current Gen Tooling Deliverable Task Owner Done
Stage koji setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling) Ralph Bean Work in Progress
integrated ability to make atomic installer and pxe to live in pungi Adam Miller Work in Progress, currently blocked on Pungi4
mash ported to createrepo_c Dennis Gilmore, Jon Disnard, Ian Mcleod, Dan Mach Not done at FAD, will be followed up on.
bodhi2 able to trigger atomic installer and pxe to live as part of the update push process. Luke Macken Currently blocking on Pungi4
livemedia-creator koji integration
koji able to manage the url line in kickstarts so that we can do real builds Brian Stinson DONE Patch submitted upstream
run-root plugin configured Dan Mach, Ralph Bean Patches required, fixed and pushed in Stage. Ansible configs in and committed for Stage. Ralph to follow up on PROD.
Secondary arches working exactly the same as primary Dennis Gilmore, Peter Robinson
port pungi to dnf Dan Mach Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion.
make headway and plan to port to python 3 Dan Mach
have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22 Mike McLean
Nice to haves: Next Gen Tooling Deliverable Task Owner Done
koji 2.0 prototype Mike McLean, Mike Bonnett

Attendees and Travel Details

Contributor Arrival Departure Roommate
Dennis Gilmore Sun 2015-05-31, AA #1299, 12:02 Mon 2015-06-08, AA #40, 19:30 Peter Robinson
Peter Robinson Sun 2015-05-31, VS #011, 15:25 Mon, 2015-06-08, VS #012, 21:50 Dennis Gilmore
Ralph Bean n/a
Remy DeCausemaker Wed 2015-06-03, US #3916, 16:55 Tues, 2015-06-09, US #3807, 17:20 TBD
Luke Macken Wed 2015-06-03, JB #494, 18:47 Tue 2015-06-09, JB #993, 19:40 Adam Miller
Mike McLean Sun 2015-05-31, JB #984, 18:45 Mon 2015-06-08, JB #1583, 18:00
Adam Miller Wed 2015-06-03, US #1389, 18:17 Mon 2015-06-08, AA #1288, 12:54 Luke Macken
Will Woods Thu 2015-06-04, DL #3504, 11:10 Mon 2015-06-08, DL #3765, 19:30 Ian McLeod
Colin Walters n/a n/a n/a
Ian McLeod Thu 2015-06-04, AA #1240, 10:24 Mon 2015-06-08, AA #40, 19:30 Will Woods
Jon Disnard Sun 2015-05-31, AA #1429, 16:39 Mon 2015-06-08, AA #1178, 16:16 TBD
Luboš Kočman Sun 2015-05-31, AA #6227, 18:55 Mon 2015-06-08, AA #6163, 19:10 Daniel Mach
Brian Stinson Thu 2015-06-04, US #1299, 12:05 Mon 2015-06-08, US #197, 17:35
Remote attendees
Dan Horak (TBD)


Plan

  1. Location: Red Hat, Westford, MA USA
  2. Date: Jun-04 to Jun-08
    • Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor)
    • Jun-05 -- 09:00am - 6:00pm - Waterford Valley CR (1st floor)
    • Jun-06 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
    • Jun-07 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
    • Jun-08 -- departure date
  3. Remote Attendees: https://redhat.bluejeans.com/4332589184
  4. Schedule
    • Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
    • Non-Fedora Engineering team domestic participants arrive Thu before
    • Fri -- Work day
    • Sat -- Work day
    • Sun -- Work day
    • Participants leave Mon (or Sunday night if required)

Logistics

Snacks/Beverages: Can be snarfed from Westford office

Breakfast:

  • Covered at hotel

Lunch:

  • Days other than Thu/Fri/Sat/Sun to be covered by attendees.
  • Thu: Order in, cost covered (est. $125)
  • Fri: Order in, cost covered (est. $125)
  • Sat: Order in, cost covered (est. $125)
  • Sun: Order in, cost covered (est. $125)

Dinner:

  • Days other than Thu/Fri/Sat/Sun to be covered by attendees
  • Thu: ad-hoc
  • Fri: Team @ local venue (est. $300)
  • Sat: Team @ local venue (est. $300)
  • Sun: Team @ local venue (est. $300)

Total food: est. $1400

Travel estimates

Contributor Taxi/transport (to/from home) Airfare Taxi/transport (to/from site) Parking Other
Dennis Gilmore - - - - covered by RCM
Peter Robinson - - - - covered by RCM
Ralph Bean $100 (gas) $ 50 (parking from F-Eng budget)
Daniel Mach - - - - covered by RCM
Luke Macken $390 $ 50 (parking from F-Eng budget)
Mike McLean - - - - covered by RCM
Adam Miller $225 $ 50 (parking from F-Eng budget)
Will Woods $210 $ 50 (parking from Anaconda or F-Eng budget)
Ian McLeod $250 $ 50
Jon Disnard - - - - covered by RCM
  1. Travel: $500 rental minivan + $1175 above = $1675
  2. Housing: $1185
    • Hampton Inn Westford/Chelmsford, <http://ur1.ca/ka20d> -- $117/night
      • for FAD budget: 1 room 4 nights, 1 room 5 nights = 9 nights + tax = ~$1185
    • Ralph Bean: $65 * 5 nights = $325
  3. Space:
    • $0 if Supplied by Red Hat
  4. Supplies:
    • N/A
  5. Food: $1400 (from above)

Total budget: $4,585

Retrieved from "https://fedoraproject.org/w/index.php?title=FAD_Release_Tools_and_Infrastructure_2015&oldid=415467"