From Fedora Project Wiki
I am currently working to create some basic metrics to report on the activities on the BugZappers. My approach is to use the python-bugzilla package as much as possible.
Tools You Will Need
- The python-bugzilla package. (Try 'yum install python-bugzilla'
- The modified bugzilla CLI to add the --summary option. I suggest saving this as ~/bin/bzilla (only because that is what I have done)
Proposed Metrics
Description | Status | Comments/Notes/Reference |
---|---|---|
# of Bugs 'Triaged' in the last xx days | DONE | See: [1] |
# of Bugs 'Triaged' in the last xx days by Current Status | DONE | bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary bug_status |
# of Bugs 'Triaged' in the last xx days by Component | DONE | bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?chfieldto=Now&query_format=advanced&chfield=keywords&chfieldfrom=-90d&chfieldvalue=Triaged&classification=Fedora&product=Fedora' --summary component |
# of Bugs 'Triaged' in the last xx days by Triager | In Process | I am working on a patch to add the ability to query/display the bug history data via XMLRPC to the python-bugzilla package. This metric will provide the list of known active BugZappers. |
# of 'Triaged' bugs CLOSED in last xx Days | DONE | See: [2] |
# of 'Triaged' bugs CLOSED in last xx Days by Resolution | DONE | bzilla query --from-url='https://bugzilla.redhat.com/buglist.cgi?keywords=Triaged&chfieldto=Now&query_format=advanced&chfield=bug_status&keywords_type=allwords&chfieldfrom=-90d&chfieldvalue=CLOSED&bug_status=CLOSED&classification=Fedora&product=Fedora' --summary resolution |
# of 'Triaged' bugs CLOSED in last xx Days by # of days since Triaged flag was set | PENDING | To know if/how 'Triaging' is impacting the life expectancy of bugs. (Need a better definition. How about 'Average number of days from Triaged to CLOSED by resolution for 'Triaged' bugs CLOSED in last xx days') |
List of 'Triaged' bugs currently marked as NEEDINFO | PENDING | This should generally be an empty list. Bugs showing up here could be an indicator of poor Triaging. See: [3] (Is this useful. Remove?) |
# of bugs CLOSED by BugZappers in last xx days | PENDING | Need a list of BugZappers |
# of bugs CLOSED by BugZappers in last xx days by BugZapper | PENDING | Need a list of BugZappers |
# of bugs CLOSED by BugZappers in last xx days by Resolution | PENDING | Need a list of BugZappers |
Additional Thoughts/Questions
- Q:Who are the BugZappers? A:BugZappers = Members of he Triagers group in FAS. But since this is not easy to scrape (and may included inactive persons) I am going to use the following definition. BugZappers = BugZilla users that have used the 'Triaged' flag in the previous 90 days.
- Eventually, these metrics should probably come from a SQL query. Pulling all this data via XMLRPC could be slow.
- Pretty graphs could be created showing how these metrics change (or don't) over time.
- What other metrics should we be tracking?
- Should these metric be limited to bugs where Product=Fedora & Classification=Fedora?
Current Metrics as of June 28, 2010
Bugs 'Triaged' in the last 60 Days: 229
Summary of Bugs 'Triaged' in the last 60 days by Current Status: ASSIGNED - 54 CLOSED - 40 MODIFIED - 1 NEW - 132 ON_QA - 2
Summary of Bugs 'Triaged' in the last 60 days by Component: PackageKit - 19 amarok - 2 anaconda - 1 banshee - 1 compiz - 2 compiz-fusion - 1 digikam - 1 epiphany - 1 evince - 1 evolution - 3 fedora-bookmarks - 1 firefox - 30 gcc - 1 glib2 - 1 glob2 - 1 gnome-desktop - 1 gnome-panel - 1 gnome-session - 1 initscripts - 4 java-1.6.0-openjdk - 1 k3b - 1 kcm-gtk - 1 kde-plasma-networkmanagement - 2 kdeaccessibility - 1 kdebase - 1 kdebase-workspace - 1 kdegraphics - 1 kdenetwork - 1 kdepim - 3 kdeutils - 1 kernel - 2 knetworkmanager - 2 libX11 - 2 libXfixes - 1 libdrm - 1 libtiff - 2 livecd-tools - 1 me-tv - 1 mesa - 2 phonon - 1 pixman - 1 preupgrade - 1 seamonkey - 4 strigi - 6 sugar - 1 system-config-display - 1 system-config-users - 1 thunderbird - 5 xine-lib - 2 xine-ui - 1 xorg-x11-drv-ati - 26 xorg-x11-drv-evdev - 1 xorg-x11-drv-intel - 22 xorg-x11-drv-nouveau - 24 xorg-x11-drv-radeonhd - 1 xorg-x11-drv-sis - 1 xorg-x11-drv-synaptics - 1 xorg-x11-drv-vmmouse - 3 xorg-x11-drv-vmware - 1 xorg-x11-drv-wacom - 6 xorg-x11-server - 12 xulrunner - 1 yum - 1 zlib - 4
# of 'Triaged' bugs CLOSED in last 60 Days: 476
Summary of 'Triaged' bugs CLOSED in last 60 Days by Resolution: CANTFIX - 4 CURRENTRELEASE - 21 DEFERRED - 1 DUPLICATE - 23 ERRATA - 71 INSUFFICIENT_DATA - 53 NEXTRELEASE - 15 NOTABUG - 13 RAWHIDE - 147 UPSTREAM - 5 WONTFIX - 101 WORKSFORME - 22