(→How to test?: Event configuration) |
(Drop direct Test Days category membership) |
||
(91 intermediate revisions by 13 users not shown) | |||
Line 23: | Line 23: | ||
=== Prerequisite for Test Day === | === Prerequisite for Test Day === | ||
You will need either fully updated Fedora 15 system or a | You will need either fully updated Fedora 15 system or a [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ LiveCD image] (download desktop spin). | ||
{{admon/important|If your system doesn't boot|There is currently some [https://bugzilla.redhat.com/show_bug.cgi?id{{=}}692436 problem] with SELinux that prevents system from booting on fully updated Fedora 15 installation. If that happens to you, add <code>enforcing{{=}}0</code> on kernel boot line in GRUB and the system should boot fine.}} | |||
If | |||
=== How to test? === | === How to test? === | ||
Prior to test: | |||
* Fully update ABRT packages (even when running from LiveCD): | |||
<pre> | |||
# yum update 'abrt*' --enablerepo=updates-testing | |||
</pre> | |||
* Make sure '''abrtd''' and '''abrt-ccpp''' services are running: | |||
<pre> | |||
# service abrtd start | |||
Starting abrtd (via systemctl): [ OK ] | |||
# service abrt-ccpp start | |||
Starting abrt-ccpp (via systemctl): [ OK ] | |||
</pre> | |||
* File {{filename|/proc/sys/kernel/core_pattern}} contains following output: | |||
<pre> | |||
# cat /proc/sys/kernel/core_pattern | |||
|/usr/libexec/abrt-hook-ccpp /var/spool/abrt %s %c %p %u %g %t %h %e 636f726500 | |||
</pre> | |||
Please follow each of following | Please follow each of following ABRT test cases and sum up the results in the table below: | ||
# [[QA:Testcase ABRT CCPP addon]] - C/C++ tracebacks | # [[QA:Testcase ABRT CCPP addon]] - C/C++ tracebacks | ||
# [[QA:Testcase ABRT python]] - python tracebacks | # [[QA:Testcase ABRT python]] - python tracebacks | ||
# [[QA:Testcase ABRT kernel]] - kernel oops | # [[QA:Testcase ABRT kernel]] - kernel oops | ||
# [[QA:TestCase ABRT BlackList]] - package blacklist | # [[QA:TestCase ABRT BlackList]] - package blacklist | ||
# [[QA:Testcase ABRT quota]] - limiting the space occupied by ABRT's cache | # [[QA:Testcase ABRT quota]] - limiting the space occupied by ABRT's cache | ||
# [[QA:Testcase ABRT Bugzilla]] - Bugzilla plugin | # [[QA:Testcase ABRT Bugzilla]] - Bugzilla plugin | ||
# [[QA:Testcase ABRT Logger]] - Logger plugin | # [[QA:Testcase ABRT Logger]] - Logger plugin | ||
Line 58: | Line 71: | ||
=== Test Results === | === Test Results === | ||
If you have suggestions about UI, send them via email to developers and/or create a bug report. | |||
Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] against the '''abrt''' component and Fedora 15 release. | Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] against the '''abrt''' component and Fedora 15 release. | ||
{| | {| style="font-size: smaller" | ||
! User | ! User | ||
! [[QA:Testcase ABRT CCPP addon|CCPP]] | ! [[QA:Testcase ABRT CCPP addon|CCPP]] | ||
! [[QA:Testcase ABRT python|python]] | ! [[QA:Testcase ABRT python|python]] | ||
! [[QA:Testcase ABRT kernel|kernel]] | ! [[QA:Testcase ABRT kernel|kernel]] | ||
! [[QA:TestCase ABRT BlackList|Blacklist]] | ! [[QA:TestCase ABRT BlackList|Blacklist]] | ||
! [[QA:Testcase ABRT quota|quota]] | ! [[QA:Testcase ABRT quota|quota]] | ||
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]] | ! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]] | ||
! [[QA:Testcase_ABRT_Logger|Logger]] | ! [[QA:Testcase_ABRT_Logger|Logger]] | ||
Line 79: | Line 93: | ||
! [[QA:Testcase Retrace Server CLI|RS CLI]] | ! [[QA:Testcase Retrace Server CLI|RS CLI]] | ||
! [[QA:Testcase Retrace Server GUI|RS GUI]] | ! [[QA:Testcase Retrace Server GUI|RS GUI]] | ||
! [[QA:Testcase ABRT third party event extension|3rd-party]] | |||
! References | ! References | ||
|- | |- | ||
| [[User:Sample User|Sample User]] | | [[User:Sample User|Sample User]] | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> | | {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> | ||
| {{result|fail}} <ref>{{bz|12345}}</ref> | | {{result|fail}} <ref>{{bz|12345}}</ref> | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
Line 95: | Line 113: | ||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| <references/> | |||
|- | |||
| [[User:jskarvad|Jaroslav Škarvada]] | |||
| {{result|warn}} <ref group="long">Got message: Need writable directory, but '/var/spool/abrt/ccpp-2011-03-31-11:52:18-1939' is not writable. Move it to '/home/yarda/.abrt/spool' and operate on the moved copy?<br/>But:<br/># rpm -V abrt<br/>.....UGM. /var/run/abrt</ref> | |||
<ref group="long">Got many: Certificate is signed by an untrusted issuer: 'E=mtoman@redhat.com,CN =retrace01.fedoraproject.org,OU=BaseOS,O=Red Hat,L=Brno,C=CZ'.</ref> | |||
<ref>There is no "Open ABRT" button, only "Show".</ref> | |||
<ref group="long">Got message: Missing separate debuginfo for | |||
Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/45/190d029703ca464ad5c5eb6b7f99426a51a2e3</ref> | |||
| {{result|pass}} | |||
| {{result|warn}} <ref>There was no notification after the /var/log/messages modification.</ref> | |||
| {{result|fail}} | |||
| {{result|pass}} | |||
| {{result|pass}} <ref group="long">Passed, but the UI is ugly and confusing, e.g. I would like to be able to enter the bugzilla credentials (or create new account) after clicking the last confirmation button.</ref> | |||
| {{result|pass}} | |||
| {{result|pass}} <ref group="long">Instructions about configuration of the abrt_event.conf and mailx plugin (Mailx.conf file needs to be created because it doesn't exist) are incomplete.</ref> | |||
| {{result|pass}} | |||
| {{result|warn}} <ref>There is no "Edit->Plugins", probably "Edit->Event configuration" was meant and it worked as expected.</ref> | |||
| {{result|pass}} <ref group="long">I would prefer to be able to select reporter by e.g. number (or combination of numbers) and not to cycle Y/N through all available reporters.</ref> | |||
<ref>In this test case several instructions are misplaced to "Expected results".</ref> | |||
| {{result|fail}} <ref group="long">It is not fully localized to cs_CZ, e.g. "Problem", "Last Occurence", "Online Help", "Event Configuration" (and all strings in this dialog) strings are not localized.</ref> | |||
| {{result|fail}} <ref>A lot of messages are not localized to cs_CZ, e.g. "is not writable", "Choose option", "Analyzing coredump" and much much more.</ref> | |||
| {{result|pass}} <ref>It is not clear from the testcase where "batch" command stores downloaded data.</ref> | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:dkutalek|David Kutalek]] | |||
| {{result|warn}} <ref>{{bz|692428}} - Report button in warning inside KDE info area does not work</ref> <ref>{{bz|692433}} - Cannot connect to Gnome keyring daemon dialog becomes annoying</ref> | |||
| {{result|pass}} | |||
| {{result|pass}} <ref>Event settings for kernel opps is located in /etc/abrt/events.d/koops_events.conf</ref> <ref>abrt-dump-opps log scanner has parameters -drwx (not -drw)</ref> | |||
| {{result|warn}} <ref>[https://bugzilla.redhat.com/show_bug.cgi?id=692465#c5]</ref> | |||
| {{result|pass}} | |||
| {{result|fail}} <ref>{{bz|692574}} - Not possible to report to bugzilla without gnome keyring</ref> | |||
| {{result|pass}} <ref>By default on Live CD there is this action: abrt-action-print -o "${Log_File:-/tmp/abrt.log}" -a "${Append:-no}"</ref> <ref>Again because of missing gnome keyring, it is not possible to alter event config in gui.</ref> | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|warn}} <ref>{{bz|692803}} - Bad integration with KDE - without gnome-keyring - see above</ref> | |||
| {{result|pass}} <ref>Works, but after reporting using logger and/or Mailx, crash is not marked as reported. Same for GUI. Is it intended?</ref> | |||
| {{result|warn}} <ref group="long">Not fully translated to Czech, but according to link to translation service, missing pieces were already translated - probably only not included in packages yet.</ref> | |||
| {{result|warn}} <ref>Again some messages not translated</ref> | |||
| {{result|pass}} | |||
| {{result|warn}} <ref>{{bz|692802}} - Missing debuginfo for fedora15/sleep crash on abrt retrace server</ref> | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:vondruch|Vít Ondruch]] | |||
| {{result|warn}} <ref>Same experience as jskarvad</ref> | |||
<ref>{{bz|692442}} - Hi res image for "bug-reporting-window" and task switcher</ref> | |||
<ref>{{bz|692444}} - "bug-reporting-window" should be shown as "part of the application"</ref> | |||
| {{result|pass}} | |||
| {{result|warn}} | |||
<ref>abrt_event.conf does not contain the events mentioned in test case</ref> | |||
<ref>abrt.conf contains -drwx instead of -drw</ref> | |||
| {{result|fail}} | |||
<ref>{{bz|692465}} - Blacklist doesn't work</ref> | |||
| {{result|warn}} | |||
<ref>{{bz|692474}} - Exceeded quota is not reported</ref> | |||
| {{result|pass}} | |||
<ref group="long">The "configure event" is far from intuitive for bugzilla account configuration. The credentials should be explicitly requested from user if they are not configured instead of some strange error report.</ref> | |||
| {{result|pass}} | |||
| | |||
| {{result|fail}} | |||
<ref>I have not /var/cache/abrt directory on my system. Even if I create one, nothing appears in there.</ref> | |||
| {{result|warn}} | |||
<ref>{{bz|692516}} - The ABRT icon is almost invisible in panel</ref> | |||
| | |||
| | |||
| | |||
| | |||
| | |||
| | |||
| <references/> | |||
|- | |||
| [[User:kparal|kparal]] | |||
| {{result|pass}} | | {{result|pass}} | ||
| {{result|pass}} | | {{result|pass}} | ||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | | {{result|none}} | ||
| {{result|none}} | | {{result|none}} | ||
| <references/> | | <references/> | ||
|- | |||
| [[User:mnowak|Michal Nowak]] | |||
| {{result|pass}}<ref>[https://fedorahosted.org/abrt/ticket/185 #185 Not very sane error message: '11' does not exist]</ref> | |||
| {{result|pass}}<ref>[https://fedorahosted.org/abrt/ticket/186 #186 Problem notification from abrt won't pop-up in gnome-shell]</ref> | |||
| {{result|pass}} | |||
<ref>[https://fedorahosted.org/abrt/ticket/187 #187 exit code == 0 on "abrt-dump-oops: 1 errors while dumping oopses"]</ref> | |||
<ref>[https://fedorahosted.org/abrt/ticket/188 #188 Option `-d` should be documented as a root-only, or made to work for user]</ref> | |||
| {{result|fail}}<ref>{{bz|692465}} - Blacklist doesn't work</ref> | |||
| {{result|pass}} | |||
| {{result|pass}}<ref group="long">[https://fedorahosted.org/abrt/ticket/191 #191 When duplicate in Bugzilla is detected, abrt-gui should give more valuable information than "exit code = 139"]</ref> | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}}<ref>[https://fedorahosted.org/abrt/ticket/193 #193 `abrt-cli -l` should not show reported cases]</ref> | |||
| {{result|warn}}<ref>Not everything was translated, not sure it's abrt problem or that it's just not translated.</ref> | |||
| {{result|warn}}<ref>Not everything was translated, not sure it's abrt problem or that it's just not translated.</ref> | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| '''Other issues''' | |||
<ref>[https://fedorahosted.org/abrt/ticket/189 #189 abrtd should reload configuration when some of it's config files changes]</ref> | |||
<ref>[https://fedorahosted.org/abrt/ticket/192 #192 @@LOCALSTATEDIR@@ should be populated by automake]</ref> | |||
<references/> | |||
|- | |||
| [[User:lewis41|Luigi Votta]] | |||
| {{result|warn}}<ref>Same problema as jskarvad</ref> | |||
| {{result|warn}}<ref>Unable to catch in abrt the python error</ref> | |||
| {{result|pass}} | |||
| {{result|warn}}<ref>It doesn't seem working</ref> | |||
| {{result|warn}}<ref>Same as previous {{bz|692474}}</ref> | |||
| {{result|fail}}<ref>cannot retrieve debug-info from repo as in {{bz|681281}}</ref> | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| {{result|}} | |||
| <references/> | |||
|- | |||
| [[User:redwolfe|G.Wolfe Woodbury]] | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|pass}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|pass}} <ref>{{bz|692549}} {{bz|692554}} {{bz|692557}} real bugs</ref> | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|warn}} <ref>lots of PENDING notices, retreated to local gdb</ref> | |||
| {{result|none}} | |||
| <references/> | |||
|- | |||
| [[User:hhorak|Honza Horak]] | |||
| {{result|warn}} <ref>Got message: Need writable directory, but /var/spool/abrt/ccpp-...10080/ is not writable</ref><ref group="long">there is no indications that something is being done during downloading debuginfo packages; some "loading..." message would prevent impatient user from closing the window untimely</ref> | |||
| {{result|warn}} <ref>Empty login or password, please check /etc/abrt/plugins/Bugzilla.conf.. But there is both set, but not in abrt-gui.</ref> | |||
| {{result|pass}} | |||
| {{result|fail}} <ref>I still see strace's report when killing "strace sleep 5m".</ref> | |||
| {{result|warn}} <ref>I see no notification about quota (maybe I cannot run applet). </ref> | |||
| {{result|warn}} <ref>I cannot log in using manual edit of /etc/abrt/plugins/Bugzilla.conf, but it works using editting in abrt-gui.</ref> | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|fail}} <ref>There is no "/var/cache/abrt/" at all.</ref> | |||
| {{result|warn}} <ref>I see no siren logo in F15 - maybe not ABRT issue.</ref> | |||
| {{result|pass}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| {{result|none}} | |||
| <references/> | |||
|- | |||
! User | |||
! [[QA:Testcase ABRT CCPP addon|CCPP]] | |||
! [[QA:Testcase ABRT python|python]] | |||
! [[QA:Testcase ABRT kernel|kernel]] | |||
! [[QA:TestCase ABRT BlackList|Blacklist]] | |||
! [[QA:Testcase ABRT quota|quota]] | |||
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]] | |||
! [[QA:Testcase_ABRT_Logger|Logger]] | |||
! [[QA:Testcase_ABRT_Mailx|Mailx]] | |||
! [[QA:Testcase ABRT sosreport|sosreport]] | |||
! [[QA:Testcase ABRT GUI MAIN|GUI]] | |||
! [[QA:Testcase ABRT CLI|CLI]] | |||
! [[QA:Testcase ABRT GUI Localized|GUI L10N]] | |||
! [[QA:Testcase ABRT CLI Localized|CLI L10N]] | |||
! [[QA:Testcase Retrace Server CLI|RS CLI]] | |||
! [[QA:Testcase Retrace Server GUI|RS GUI]] | |||
! [[QA:Testcase ABRT third party event extension|3rd-party]] | |||
! References | |||
|- | |- | ||
|} | |} | ||
[[Category:Fedora 15 Test Days]] | == Long comments == | ||
<references group="long" /> | |||
[[Category:Fedora 15 Test Days]] |
Latest revision as of 19:37, 26 June 2015
Fedora Test Days | |
---|---|
ABRT 2 + Retrace Server | |
Date | 2011-03-31 |
Time | all day |
Website | https://fedorahosted.org/abrt/ |
IRC | #fedora-test-day (webirc) |
Mailing list | test |
What to test?[edit]
Today's installment of Fedora Test Day will focus on Retrace Server and Automated Bug Reporting Tool (ABRT).
Who's available[edit]
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
- Development - Jiří Moskovčák (jmoskovc), Nikola Pajkovsky (npajkovs), Denys Vlasenko (dvlasenk), Karel Klíč (kklic), Michal Toman (mtoman)
- Quality Assurance - Michal Nowak (mnowak)
Prerequisite for Test Day[edit]
You will need either fully updated Fedora 15 system or a LiveCD image (download desktop spin).
How to test?[edit]
Prior to test:
- Fully update ABRT packages (even when running from LiveCD):
# yum update 'abrt*' --enablerepo=updates-testing
- Make sure abrtd and abrt-ccpp services are running:
# service abrtd start Starting abrtd (via systemctl): [ OK ] # service abrt-ccpp start Starting abrt-ccpp (via systemctl): [ OK ]
- File
/proc/sys/kernel/core_pattern
contains following output:
# cat /proc/sys/kernel/core_pattern |/usr/libexec/abrt-hook-ccpp /var/spool/abrt %s %c %p %u %g %t %h %e 636f726500
Please follow each of following ABRT test cases and sum up the results in the table below:
- QA:Testcase ABRT CCPP addon - C/C++ tracebacks
- QA:Testcase ABRT python - python tracebacks
- QA:Testcase ABRT kernel - kernel oops
- QA:TestCase ABRT BlackList - package blacklist
- QA:Testcase ABRT quota - limiting the space occupied by ABRT's cache
- QA:Testcase ABRT Bugzilla - Bugzilla plugin
- QA:Testcase ABRT Logger - Logger plugin
- QA:Testcase ABRT Mailx - Mailx plugin
- QA:Testcase ABRT SOSreport plugin - sosreport integration with ABRT
- QA:Testcase ABRT GUI MAIN - testing the GUI (probably already during the previous steps, so just to sum it up)
- QA:Testcase ABRT CLI - CLI interface
- QA:Testcase ABRT GUI Localized - exploring localized GUI
- QA:Testcase ABRT CLI Localized - exploring localized CLI
- QA:Testcase Retrace Server CLI - Retrace Server CLI
- QA:Testcase Retrace Server GUI - Retrace Server in ABRT GUI
- QA:Testcase ABRT third party event extension - event configuration
Test Results[edit]
If you have suggestions about UI, send them via email to developers and/or create a bug report.
Please report all bugs into Bugzilla against the abrt component and Fedora 15 release.
User | CCPP | python | kernel | Blacklist | quota | Bugzilla | Logger | Mailx | sosreport | GUI | CLI | GUI L10N | CLI L10N | RS CLI | RS GUI | 3rd-party | References |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Sample User | |||||||||||||||||
Jaroslav Škarvada |
| ||||||||||||||||
David Kutalek |
| ||||||||||||||||
Vít Ondruch |
| ||||||||||||||||
kparal | |||||||||||||||||
Michal Nowak | Other issues
| ||||||||||||||||
Luigi Votta | |||||||||||||||||
G.Wolfe Woodbury | |||||||||||||||||
Honza Horak |
| ||||||||||||||||
User | CCPP | python | kernel | Blacklist | quota | Bugzilla | Logger | Mailx | sosreport | GUI | CLI | GUI L10N | CLI L10N | RS CLI | RS GUI | 3rd-party | References |
Long comments[edit]
- ↑ Got message: Need writable directory, but '/var/spool/abrt/ccpp-2011-03-31-11:52:18-1939' is not writable. Move it to '/home/yarda/.abrt/spool' and operate on the moved copy?
But:
# rpm -V abrt
.....UGM. /var/run/abrt - ↑ Got many: Certificate is signed by an untrusted issuer: 'E=mtoman@redhat.com,CN =retrace01.fedoraproject.org,OU=BaseOS,O=Red Hat,L=Brno,C=CZ'.
- ↑ Got message: Missing separate debuginfo for Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/45/190d029703ca464ad5c5eb6b7f99426a51a2e3
- ↑ Passed, but the UI is ugly and confusing, e.g. I would like to be able to enter the bugzilla credentials (or create new account) after clicking the last confirmation button.
- ↑ Instructions about configuration of the abrt_event.conf and mailx plugin (Mailx.conf file needs to be created because it doesn't exist) are incomplete.
- ↑ I would prefer to be able to select reporter by e.g. number (or combination of numbers) and not to cycle Y/N through all available reporters.
- ↑ It is not fully localized to cs_CZ, e.g. "Problem", "Last Occurence", "Online Help", "Event Configuration" (and all strings in this dialog) strings are not localized.
- ↑ Not fully translated to Czech, but according to link to translation service, missing pieces were already translated - probably only not included in packages yet.
- ↑ The "configure event" is far from intuitive for bugzilla account configuration. The credentials should be explicitly requested from user if they are not configured instead of some strange error report.
- ↑ #191 When duplicate in Bugzilla is detected, abrt-gui should give more valuable information than "exit code = 139"
- ↑ there is no indications that something is being done during downloading debuginfo packages; some "loading..." message would prevent impatient user from closing the window untimely