FAD Release Tools and Infrastructure 2015: Difference between revisions

This is the main page for FAD Release Tools and Infrastructure 2015. This hackathon is intended to take release tools and process to the next level in Fedora for F23/F24 and beyond.

Modularize the compose process
Replace serial bash script with easier to hack and maintain Python tools
Establish dependency management of compose deliverables
Cut time to provide updates to users for critical security fixes

Purpose

Our purpose is to complete the following primary goals:
- Create repositories and workflow for code collaboration including patch review
  - Where will the code be stored? Where will patches and commit messages go?
  - Who can approve patches? How does one get commit access? (Note: This should be as many responsible/trusted committers as possible, in accordance with good community practice)
- Complete any remaining architecture/design details for new release tools
  - As much of this should be worked out on mailing list and IRC before the FAD as possible
  - If additional VMs are needed, complete RFRs for infrastructure
- Hack (possibly fedmsg-based) framework for product compose
- (stand up VMs and/or ansible playbooks for required systems?)
- ...
In addition, we will attempt to complete the following secondary goals as time allows:
- Early sessions on Fedora Hubs design/user stories - Thursday, Fedora Engineering team members + Remy
- ...

Detailed Work Items & Final Attendees

Priorities

As per the rel-eng FAD priority mailing list thread

Priorities: Current Gen Tooling	Task Owner	Done
working pungi 4	Adam Miller, Dennis Gilmore, John Disnard, Dan Mach	Mostly done, still debugging a createrepo issue though.
rawhide looking like a TC/RC	Adam Miller, Dennis Gilmore	Blocked on Pungi4
Determine how stage koji needs to be setup/configured to be useful as a place to deploy dev versions of rel-eng tooling and then get it setup/deployed, ansiblized.	Ralph Bean	DONE Follow Up
Prorities: Next Gen Tooling	Task Owner	Done
define what composedb should be	Adam Miller, Ralph Bean	Work in progress, proposal to mailing list pending write up
koji 2.0 Draft document (Discussion has begun here. Deliverable would be a well documented plan that can begin to be executed upon.	Mike McLean, Mike Bonnett	DONE - Awaiting proposal/writeup to koji-devel mailing list
koji content generators and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x)	Mike McLean, Mike Bonnett	DONE - Awaiting proposal/writeup to koji-devel mailing list - Also a lot of documentation here.

Deliverables

Nice to haves: Current Gen Tooling Deliverable	Task Owner	Done
Stage koji setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling)	Ralph Bean	Work in Progress
integrated ability to make atomic installer and pxe to live in pungi	Adam Miller	Work in Progress, currently blocked on Pungi4
mash ported to createrepo_c	Dennis Gilmore, Jon Disnard, Ian Mcleod, Dan Mach	Not done at FAD, will be followed up on.
bodhi2 able to trigger atomic installer and pxe to live as part of the update push process.	Luke Macken	Currently blocking on Pungi4
livemedia-creator koji integration
koji able to manage the url line in kickstarts so that we can do real builds	Brian Stinson	DONE Patch submitted upstream
run-root plugin configured	Dan Mach, Ralph Bean	Patches required, fixed and pushed in Stage. Ansible configs in and committed for Stage. Ralph to follow up on PROD.
Secondary arches working exactly the same as primary	Dennis Gilmore, Peter Robinson
port pungi to dnf	Dan Mach	Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion.
make headway and plan to port to python 3	Dan Mach
have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22	Mike McLean
Nice to haves: Next Gen Tooling Deliverable	Task Owner	Done
koji 2.0 prototype	Mike McLean, Mike Bonnett

Attendees and Travel Details

Contributor	Arrival	Departure	Roommate
Dennis Gilmore	Sun 2015-05-31, AA #1299, 12:02	Mon 2015-06-08, AA #40, 19:30	Peter Robinson
Peter Robinson	Sun 2015-05-31, VS #011, 15:25	Mon, 2015-06-08, VS #012, 21:50	Dennis Gilmore
Ralph Bean			n/a
Remy DeCausemaker	Wed 2015-06-03, US #3916, 16:55	Tues, 2015-06-09, US #3807, 17:20	TBD
Luke Macken	Wed 2015-06-03, JB #494, 18:47	Tue 2015-06-09, JB #993, 19:40	Adam Miller
Mike McLean	Sun 2015-05-31, JB #984, 18:45	Mon 2015-06-08, JB #1583, 18:00
Adam Miller	Wed 2015-06-03, US #1389, 18:17	Mon 2015-06-08, AA #1288, 12:54	Luke Macken
Will Woods	Thu 2015-06-04, DL #3504, 11:10	Mon 2015-06-08, DL #3765, 19:30	Ian McLeod
Colin Walters	n/a	n/a	n/a
Ian McLeod	Thu 2015-06-04, AA #1240, 10:24	Mon 2015-06-08, AA #40, 19:30	Will Woods
Jon Disnard	Sun 2015-05-31, AA #1429, 16:39	Mon 2015-06-08, AA #1178, 16:16	TBD
Luboš Kočman	Sun 2015-05-31, AA #6227, 18:55	Mon 2015-06-08, AA #6163, 19:10	Daniel Mach
Brian Stinson	Thu 2015-06-04, US #1299, 12:05	Mon 2015-06-08, US #197, 17:35
Remote attendees
Dan Horak (TBD)

Plan

Location: Red Hat, Westford, MA USA
Date: Jun-04 to Jun-08
- Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor)
- Jun-05 -- 09:00am - 6:00pm - Waterford Valley CR (1st floor)
- Jun-06 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
- Jun-07 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
- Jun-08 -- departure date
Remote Attendees: https://redhat.bluejeans.com/4332589184
Schedule
- Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
- Non-Fedora Engineering team domestic participants arrive Thu before
- Fri -- Work day
- Sat -- Work day
- Sun -- Work day
- Participants leave Mon (or Sunday night if required)

Logistics

Snacks/Beverages: Can be snarfed from Westford office

Breakfast:

Covered at hotel

Lunch:

Days other than Thu/Fri/Sat/Sun to be covered by attendees.
Thu: Order in, cost covered (est. $125)
Fri: Order in, cost covered (est. $125)
Sat: Order in, cost covered (est. $125)
Sun: Order in, cost covered (est. $125)

Dinner:

Days other than Thu/Fri/Sat/Sun to be covered by attendees
Thu: ad-hoc
Fri: Team @ local venue (est. $300)
Sat: Team @ local venue (est. $300)
Sun: Team @ local venue (est. $300)

Total food: est. $1400

Travel estimates

Contributor	Taxi/transport (to/from home)	Airfare	Taxi/transport (to/from site)	Parking	Other
Dennis Gilmore	-	-	-	-	covered by RCM
Peter Robinson	-	-	-	-	covered by RCM
Ralph Bean		$100 (gas)		$ 50	(parking from F-Eng budget)
Daniel Mach	-	-	-	-	covered by RCM
Luke Macken		$390		$ 50	(parking from F-Eng budget)
Mike McLean	-	-	-	-	covered by RCM
Adam Miller		$225		$ 50	(parking from F-Eng budget)
Will Woods		$210		$ 50	(parking from Anaconda or F-Eng budget)
Ian McLeod		$250		$ 50
Jon Disnard	-	-	-	-	covered by RCM

Travel: $500 rental minivan + $1175 above = $1675
Housing: $1185
- Hampton Inn Westford/Chelmsford, <http://ur1.ca/ka20d> -- $117/night
  - for FAD budget: 1 room 4 nights, 1 room 5 nights = 9 nights + tax = ~$1185
- Ralph Bean: $65 * 5 nights = $325
Space:
- $0 if Supplied by Red Hat
Supplies:
- N/A
Food: $1400 (from above)

Total budget: $4,585

@@ Line 65: / Line 65: @@
 | run-root plugin configured || Dan Mach, Ralph Bean || [https://lists.fedorahosted.org/pipermail/koji-devel/2015-June/000026.html Patches required], [http://koji.stg.fedoraproject.org/koji/taskinfo?taskID=537343 fixed and pushed in Stage]. Ansible configs in and committed for Stage. Ralph to follow up on PROD.
 |-
-| Secondary arches working exactly the same as primary || [[User:Ausil | Dennis Gilmore]], [[User:Pbrobinson | Peter Robinson ||
+| Secondary arches working exactly the same as primary || [[User:Ausil | Dennis Gilmore]], [[User:Pbrobinson | Peter Robinson]] ||
 |-
 | port pungi to dnf || Dan Mach || Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion.

Search