From Fedora Project Wiki

mNo edit summary
 
(24 intermediate revisions by 9 users not shown)
Line 1: Line 1:
This is the main page for a CI and Infrastructure hackathon 2017. This hackathon is intended to help the team leap ahead for several critical Fedora initiatives.
This is the main page for a CI and Infrastructure hackathon 2017. This hackathon is intended to help the team leap ahead for several critical Fedora initiatives.
== Working Session Notes ==
There is a [[Gobby]] Doc named '''CI-Infrastructure-Hackathon-2017''' where notes will be kept about the working session.
=== Output and outcomes ===
* [https://blog.electronsweatshop.com/2017-ci-and-infrastructure-hackathon.html Randy Barlow's blog entry]
* [https://www.scrye.com/wordpress/nirik/2017/05/15/ci-and-infrastructure-hackfest-2017/ Kevin Fenzi's blog entry]
* [https://www.jcline.org/blog/fedora/2017/05/18/ci-and-infrastructure-hackathon-2017.html Jeremy Cline's blog entry]


== Purpose ==
== Purpose ==
Line 8: Line 20:
# Continue and/or complete key CI pipeline implementation -- ''(est. 2 days)''
# Continue and/or complete key CI pipeline implementation -- ''(est. 2 days)''
#* ''This goal will be further outlined based on discussions between now and the event.''
#* ''This goal will be further outlined based on discussions between now and the event.''
#** Work with Mike McLean a roadmap to bring CI support to koji
#** Work with Mike McLean a roadmap to set up a dev environment for koji for future contribution
#** Start working with Mike McLean to bring CI support to koji
#** Work to bring a gating mechanism to Bodhi
# Establish an OpenShift instance in Fedora infrastructure -- ''(est. 2 days)''
# Establish an OpenShift instance in Fedora infrastructure -- ''(est. 2 days)''
#* Determine the extent to which OpenShift can be expanded beyond [https://copr.fedorainfracloud.org/coprs/maxamillion/atomic-reactor/ OSBS]
#* Determine the extent to which OpenShift can be expanded beyond [https://copr.fedorainfracloud.org/coprs/maxamillion/atomic-reactor/ OSBS]
Line 20: Line 36:
=== Deliverables ===
=== Deliverables ===


{|
{| class="table"
! Deliverables: ((AuthN/AuthZ)) !! Task Owner !! Done  
! Deliverables: ((AuthN/AuthZ)) !! Task Owner !! Done  
|-
|-
| || ||
| <strike>Build documentation for OIDC best practices in our apps</strike> Create social auth SOP || puiterwijk, jcline || {{check}}
|-
|-
! Deliverables: ((CI Pipeline)) !! Task Owner !! Done  
! Deliverables: ((CI Pipeline)) !! Task Owner !! Done  
|-
|-
| || ||
| Roadmap for CI support in Koji || pingou, mikem || {{check}}
|-
| Adjust bodhi for CI: DB change, UI and API (internal or not) / Gating mechanism in Bodhi || bowlofeggs, pingou || {{check}}
|-
| Find a solution and make a roadmap for the mapping between test results and bodhi updates || tflink, bowlofeggs, pingou || {{check}}
|-
| Get ci.centos.org to speak on the staging fedmsg bus || bstinson, puiterwijk || {{check}}
|-
| Investigate making Bodhi mashing more "continuous" while continuing to mirror sync once per day || bowlofeggs, dustymabe || {{check}}
|-
|-
! Deliverables: ((OpenShift)) !! Task Owner !! Done
! Deliverables: ((OpenShift)) !! Task Owner !! Done
|-
|-
| || ||
| Discover and record answers to all the questions on [[Infrastructure/OpenShift]] and establish roadmap || kfenzi, ssmoogen || {{check}}
|-
| OpenShift deployed in staging infrastructure || puiterwijk, maxamillion || {{check}}
|}
 
=== Follow-up tickets ===
 
{| class="table"
! Follow-up: !! Ticket
|-
| Adjust ExecDB to be more independent from buildbot so it is easier to use for CI || [https://phab.qa.fedoraproject.org/D1150 https://phab.qa.fedoraproject.org/D1150]
|-
| fedmsg-client listening to test results to adjust existing bodhi update || [https://github.com/fedora-infra/bodhi/issues/1513 https://github.com/fedora-infra/bodhi/issues/1513]
|-
| fedmsg-client listening to new bodhi update and adjust tweak their CI status if test results are already known || [https://github.com/fedora-infra/bodhi/issues/1514 https://github.com/fedora-infra/bodhi/issues/1514]
|-
| fedmsg-client listening to CI message to update execdb and resultsdb ||
|-
| Vagrant-based koji dev environment ||
|-
| Store in Bodhi the hash of the commit a build originated from || [https://github.com/fedora-infra/bodhi/issues/1512 https://github.com/fedora-infra/bodhi/issues/1512]
|-
| Cron job to update the CI status for updates missing it || [https://github.com/fedora-infra/bodhi/issues/1515 https://github.com/fedora-infra/bodhi/issues/1515]
|-
| Get the [https://fedoraproject.org/wiki/Infrastructure/Factory2/Focus/Greenwave GreenWave project] up and running ||
|-
| Document the procedure to debug/fix requests from users about askbot's social auth feature || [https://pagure.io/fedora-infrastructure/issue/6056 https://pagure.io/fedora-infrastructure/issue/6056]
|-
|-
|}
|}


=== Attendees and Travel Details ===
=== Attendees and Travel Details ===
{|
{| class="table"
! Contributor !! Arrival !! Departure !! Roommate !! Notes
! Contributor !! Arrival !! Departure !! Roommate !! Notes
|-
|-
Line 43: Line 93:
| Kevin Fenzi || Sun May 7th, 4:05pm (Flight: southwest 612) || Fri May 12th, 6:40pm (Flight southwest 3119) || Patrick U ||  
| Kevin Fenzi || Sun May 7th, 4:05pm (Flight: southwest 612) || Fri May 12th, 6:40pm (Flight southwest 3119) || Patrick U ||  
|-
|-
| Pierre-Yves Chibon || Sun May 7th, 2:12pm (Flight: AF3582) || Fri May 12th, 5:15pm (Flight AF8547) || ||  
| Pierre-Yves Chibon || Sun May 7th, 2:12pm (Flight: AF3582) || Fri May 12th, 5:15pm (Flight AF8547) || tflink ||  
|-
|-
| [[User:Maxamillion | Adam Miller]] || || || Paul F ||  
| [[User:Maxamillion | Adam Miller]] || Sun May 7th, 10:10pm (American Airlines 1207) || Saturday May 13th, 11:39am (American Airlines 2212) || Paul F ||  
|-
|-
| [[User:bowlofeggs | Randy Barlow]] || -∞ || ∞ ||  ||  
| [[User:bowlofeggs | Randy Barlow]] || -∞ || ∞ ||  ||  
Line 53: Line 103:
| Stephen Smoogen || -∞ || ∞ ||  ||  
| Stephen Smoogen || -∞ || ∞ ||  ||  
|-
|-
| Brian Stinson || || || ||  
| Brian Stinson || 2017-05-05 @ 12:20 (Flight: AA3736) || 2017-05-12 @ 11:39 (Flight: AA2212) || relrod? ||  
|-
|-
| Tim Flink? || 2017-05-07 @ 15:17 || 2017-05-12 @ 15:55 || || needs to find roommate
| Tim Flink? || 2017-05-07 @ 15:17 (Flight: United UA294) || 2017-05-12 @ 15:55 (Flight: United UA1910) || pingou ||
|-
|-
| Ricky Elrod || || || ||
| Ricky Elrod || ||Friday, 7:10pm flight || ||
|-
|-
| [[User:pfrields | Paul Frields]] || (driving, TBD) || (driving, TBD) || Adam M ||  
| [[User:pfrields | Paul Frields]] || (driving, TBD) || (driving, TBD) || Adam M ||  
Line 105: Line 155:
== Logistics ==
== Logistics ==
'''Snacks/Beverages:''' Can be snarfed from Raleigh office
'''Snacks/Beverages:''' Can be snarfed from Raleigh office
'''Breakfast:'''
* Covered at hotel
'''Lunch:'''
* ...
'''Dinner:'''
* ...
'''Total food: est. $'''


== Travel estimates ==
== Travel estimates ==


{|
{| class="table"
! Contributor !! Taxi/transport (to/from home) !! Airfare !! Taxi/transport (to/from site) !! Parking !! Other  
! Contributor !! Taxi/transport (to/from home) !! Airfare !! Taxi/transport (to/from site) !! Parking !! Other  
|-
|-

Latest revision as of 18:04, 9 June 2018

This is the main page for a CI and Infrastructure hackathon 2017. This hackathon is intended to help the team leap ahead for several critical Fedora initiatives.

Working Session Notes

There is a Gobby Doc named CI-Infrastructure-Hackathon-2017 where notes will be kept about the working session.

Output and outcomes

Purpose

Our purpose is to complete the following primary goals:

  1. Expand skills/knowledge of authorization/authentication systems in Fedora -- (max 1 day)
    • All core sysadmin team members will understand FreeIPA/Ipsilon backend administration tasks and ensure they are documented in the Fedora Infra Sysadmin Guide
    • Key developers will understand changes needed in current apps and best practices for new ones, if applicable, and capture them in the Fedora Infra Developer Guide
  2. Continue and/or complete key CI pipeline implementation -- (est. 2 days)
    • This goal will be further outlined based on discussions between now and the event.
      • Work with Mike McLean a roadmap to bring CI support to koji
      • Work with Mike McLean a roadmap to set up a dev environment for koji for future contribution
      • Start working with Mike McLean to bring CI support to koji
      • Work to bring a gating mechanism to Bodhi
  3. Establish an OpenShift instance in Fedora infrastructure -- (est. 2 days)
    • Determine the extent to which OpenShift can be expanded beyond OSBS
    • Determine policy and workflows and what might fit in and what will stay out
      • Application development
      • Application deployment
      • Upstream collaboration with Factory 2.0
    • Develop necessary playbooks, etc. to deploy

Detailed Work Items & Final Attendees

Deliverables

Deliverables: ((AuthN/AuthZ)) Task Owner Done
Build documentation for OIDC best practices in our apps Create social auth SOP puiterwijk, jcline
Deliverables: ((CI Pipeline)) Task Owner Done
Roadmap for CI support in Koji pingou, mikem
Adjust bodhi for CI: DB change, UI and API (internal or not) / Gating mechanism in Bodhi bowlofeggs, pingou
Find a solution and make a roadmap for the mapping between test results and bodhi updates tflink, bowlofeggs, pingou
Get ci.centos.org to speak on the staging fedmsg bus bstinson, puiterwijk
Investigate making Bodhi mashing more "continuous" while continuing to mirror sync once per day bowlofeggs, dustymabe
Deliverables: ((OpenShift)) Task Owner Done
Discover and record answers to all the questions on Infrastructure/OpenShift and establish roadmap kfenzi, ssmoogen
OpenShift deployed in staging infrastructure puiterwijk, maxamillion

Follow-up tickets

Follow-up: Ticket
Adjust ExecDB to be more independent from buildbot so it is easier to use for CI https://phab.qa.fedoraproject.org/D1150
fedmsg-client listening to test results to adjust existing bodhi update https://github.com/fedora-infra/bodhi/issues/1513
fedmsg-client listening to new bodhi update and adjust tweak their CI status if test results are already known https://github.com/fedora-infra/bodhi/issues/1514
fedmsg-client listening to CI message to update execdb and resultsdb
Vagrant-based koji dev environment
Store in Bodhi the hash of the commit a build originated from https://github.com/fedora-infra/bodhi/issues/1512
Cron job to update the CI status for updates missing it https://github.com/fedora-infra/bodhi/issues/1515
Get the GreenWave project up and running
Document the procedure to debug/fix requests from users about askbot's social auth feature https://pagure.io/fedora-infrastructure/issue/6056

Attendees and Travel Details

Contributor Arrival Departure Roommate Notes
Patrick Uiterwijk Sun May 7th, 3:32pm (Flight: KL6772) Fri May 12th, 7:59pm (Flight KL7294) Kevin F
Kevin Fenzi Sun May 7th, 4:05pm (Flight: southwest 612) Fri May 12th, 6:40pm (Flight southwest 3119) Patrick U
Pierre-Yves Chibon Sun May 7th, 2:12pm (Flight: AF3582) Fri May 12th, 5:15pm (Flight AF8547) tflink
Adam Miller Sun May 7th, 10:10pm (American Airlines 1207) Saturday May 13th, 11:39am (American Airlines 2212) Paul F
Randy Barlow -∞
Jeremy Cline -∞
Stephen Smoogen -∞
Brian Stinson 2017-05-05 @ 12:20 (Flight: AA3736) 2017-05-12 @ 11:39 (Flight: AA2212) relrod?
Tim Flink? 2017-05-07 @ 15:17 (Flight: United UA294) 2017-05-12 @ 15:55 (Flight: United UA1910) pingou
Ricky Elrod Friday, 7:10pm flight
Paul Frields (driving, TBD) (driving, TBD) Adam M
Remote attendees
Aurélien Bompard
Lurkers
Ralph Bean
Matt Prahl
Mike Bonnet

Planning Prerequisites

See the How to organize a FAD list; you can keep your to-do list here.

  • Work out budget
  • Decide on Dates and Location
  • Arrange Facilities
  • List Resources
  • Be Somewhat Structured
  • Arrange Lodging
  • Arrange Refreshments
  • Arrange a Social Event -- N/A

Plan

  1. Location: Red Hat, Raleigh NC, USA
    • Red Hat Tower, 9th Floor South, "Fedora" room
    • Lodging: Courtyard Raleigh Midtown -- 1041 Wake Town Dr, Raleigh, NC 27609 -- ph (919) 821-3400 -- Red Hat rate $139 + taxes
  2. Date: 2017-May-08 to 2017-May-12
    • Visitors should arrive on Sunday May 7th if possible
  3. Remote Attendees: (include dial-in)
  4. Schedule
    • Event starts 9:30am daily
    • Event ends by noon Friday May 12th, to allow for travel outbound
    • ...

Logistics

Snacks/Beverages: Can be snarfed from Raleigh office

Travel estimates

Contributor Taxi/transport (to/from home) Airfare Taxi/transport (to/from site) Parking Other
Pierre-Yves Chibon ~142€ (home <-> Paris) AF: ~1182€
Adam Miller N/A American: ~$450 ~$50 $105
Jeremy Cline $0 $0 $0 $0
Kevin Fenzi $40 Southwest: ~420
Patrick Uiterwijk $0 KLM: $1400
Tim Flink $30 United: ~$400 $50 50 flight covered by Tim's travel budget
Ricky Elrod $20 American ~$300 ~$60
Brian Stinson Covered by Brian's travel budget
Kushal Das $600 Note: side trip from PDX
  1. Travel: $5900 (est)
  2. Housing: - $3200 (est)
    • Courtyard Raleigh Midtown -- 1041 Wake Town Dr, Raleigh, NC 27609 -- ph (919) 821-3400 -- Red Hat rate $139 + taxes
    • Possibility of 1-2 people being housed locally?
  3. Space:
    • $0 -- Supplied by Red Hat
  4. Supplies:
    • N/A
  5. Food: $600 (est -- to be paid by Fedora Engineering budget)

Total budget: $9100 estimated