Latest revision |
Your text |
Line 55: |
Line 55: |
| gnome-abrt-0.2.2-1.fc18 | | gnome-abrt-0.2.2-1.fc18 |
|
| |
|
| Use the following command to install/update all of them: | | Use the following command to install/update all of them (FIXME - recheck): |
|
| |
|
| <pre> | | <pre> |
Line 68: |
Line 68: |
| </pre> | | </pre> |
|
| |
|
| {{admon/note|Elfutils needed|Please make sure you have elfutils installed - abrt-ccpp is missing requires - [[https://bugzilla.redhat.com/show_bug.cgi?id=859674 Bug 859674]] }} | | {{admon/note|Please make sure you have elfutils installed - abrt-ccpp is missing requires ([[https://bugzilla.redhat.com/show_bug.cgi?id=859674 Bug 859674]]). }} |
|
| |
|
| Make sure that: | | Make sure that: |
Line 90: |
Line 90: |
| For better orientation there are several groups of test cases, top priority first. | | For better orientation there are several groups of test cases, top priority first. |
| Follow each of these test cases, or just some group(s) of them in case of limited time for testing. | | Follow each of these test cases, or just some group(s) of them in case of limited time for testing. |
| | (FIXME - check old ones and add a few new ones): |
|
| |
|
| === New features or test cases === | | === New features or test cases === |
Line 114: |
Line 115: |
| # [[QA:Testcase Libreport sealert]] - sealert integration | | # [[QA:Testcase Libreport sealert]] - sealert integration |
| # [[QA:Testcase Libreport anaconda]] - anaconda integration | | # [[QA:Testcase Libreport anaconda]] - anaconda integration |
| # [[QA:Testcase Libreport Anaconda Install]] - anaconda integration (directly in install)
| |
| # [[QA:Testcase Libreport firstboot]] - firstboot integration | | # [[QA:Testcase Libreport firstboot]] - firstboot integration |
| # [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI | | # [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI |
Line 122: |
Line 122: |
|
| |
|
| {{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}} | | {{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}} |
|
| |
|
| |
| {{admon/note|Try to break Abrt|Besides above test cases, fell free to experiment and try to break Abrt in your own ways. We will be happy with that :-).}}
| |
|
| |
|
| == Test Results == | | == Test Results == |
Line 138: |
Line 135: |
| ! [[QA:Testcase_ABRT|Simplified crash reporting]] | | ! [[QA:Testcase_ABRT|Simplified crash reporting]] |
| ! [[QA:Testcase_ABRT_Logger|Reporting known crash]] | | ! [[QA:Testcase_ABRT_Logger|Reporting known crash]] |
| ! [[QA:Testcase ABRT ruby gem|Ruby exceptions]] | | ! [[QA:Testcase_ABRT_Bugzilla|Ruby exceptions]] |
| ! [[QA:Testcase GNOME ABRT MAIN|Gnome ABRT]] | | ! [[QA:Testcase_ABRT_Mailx|Gnome ABRT]] |
| ! [[QA:Testcase_ABRT_Configuration_Storage|Configuration storage]] | | ! [[QA:Testcase_ABRT_Configuration_Storage|Configuration storage]] |
| ! References | | ! References |
Line 148: |
Line 145: |
| | {{result|fail}} <ref>{{bz|12345}}</ref> | | | {{result|fail}} <ref>{{bz|12345}}</ref> |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|inprogress}}
| |
| | <references/>
| |
| |-
| |
| | [[User:dkutalek|David Kutalek]]
| |
| | {{result|inprogress}}
| |
| | {{result|pass}}
| |
| | {{result|inprogress}}
| |
| | {{result|inprogress}}
| |
| | {{result|pass}} <ref>Tested with gnome shell</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:mtoman|Michal Toman]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|warn}} <ref>will-crash package is not built for F18, you need to install the F17 version from koji</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | <references/>
| |
| |-
| |
| | [[User:mkyral|Martin Kyral]]
| |
| | {{result|warn}} <ref>Wrong BZ configuration leads to processing failure with no possibility of recovery {{bz|861899}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | <references/>
| |
| |-
| |
| | [[User:isenfeld|Iveta Senfeldova]]
| |
| | {{result|pass}} <ref>Problem with tabs highlighting, confusing warning message: {{bz|861880}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Same as Brano Nater, popup does not show up.</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:bnater|Brano Nater]]
| |
| | {{result|pass}} <ref>note added to {{bz|861880}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref group="long">No popup (step 7.) for gnome-keyring appear. A new record for report_Bugzilla appears in "Password and Keys" application, but it's incorrectly populated</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:jskarvad|Jaroslav Skarvada]]
| |
| | {{result|pass}}
| |
| | {{result|warn}} <ref>Processing failed. ---Running report_uReport --- (exited with 1), on second try it worked, thus no reproducer.</ref>
| |
| | {{result|warn}} <ref>No will-crash package, had to install from koji.</ref>
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Secret Service is not available, your settings won't be saved!</ref>
| |
| | <references/> | | | <references/> |
| |- | | |- |
| | [[User:Adamjosephcook|Adam Joseph Cook]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}} <ref>All tests passed.</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}} <ref>All tests passed. Test instructions not clear. All password keyrings must be deleted before test for the popup to appear.</ref>
| |
| | <references/>
| |
| |} | | |} |
|
| |
|
Line 222: |
Line 163: |
| ! References | | ! References |
| |- | | |- |
| | [[User:dkutalek|David Kutalek]] | | | [[User:SampleUser|Sample User]] |
| | {{result|warn}} <ref>Test passed, but processing window is wider then screen {{bz|861872}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Not able to report issue because of {{bz|854266}}</ref>
| |
| | {{result|pass}} | | | {{result|pass}} |
| | | {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> |
| | | {{result|fail}} <ref>{{bz|12345}}</ref> |
| | | {{result|inprogress}} |
| | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | <references/>
| |
| |-
| |
| | [[User:mtoman|Michal Toman]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>AVC {{bz|854266}}</ref><ref>In permissive doesn't work for the oops from the testcase, but works for all random oopses on my system.</ref>
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | <references/>
| |
| |-
| |
| | [[User:mtoman|Martin Kyral]]
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Needed to repeat the procedure for the issue to be written in the log {{bz|861973}}</ref>
| |
| | {{result|warn}} <ref>Wrong BZ configuration leads to processing failure with no possibility of recovery {{bz|861899}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|fail}} <ref>No kernel dump created (five tries in VirtualBox)</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:isenfeld|Iveta Senfeldova]]
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>If I closed the Problem data window report-gtk got killed: {{bz|861989}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}}<ref>AVC {{bz|854266}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | <references/>
| |
| |-
| |
| | [[User:jskarvad|Jaroslav Skarvada]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>No bugzilla in the menu.</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}} <ref>Instructions are not clear about DIR location.</ref>
| |
| | {{result|warn}} <ref>'Can't find kernel package corresponding to '2.6.27.9-159.fc10.i686', but at least catched.</ref>
| |
| | {{result|pass}}
| |
| | N/A
| |
| | <references/>
| |
| |-
| |
| | [[User:Adamjosephcook|Adam Joseph Cook]]
| |
| | {{result|fail||863813}}
| |
| | {{result|warn||861973}}
| |
| | {{result|warn||861973}} <ref>Test instructions not clear. Bugzilla reporting under report-gui->Preferences.</ref>
| |
| | {{result|warn||861973}}
| |
| | {{result|pass}} <ref>Test instructions not clear. DIR is 'Directory' field in command 'abrt-cli list'.</ref>
| |
| | {{result|fail}} <ref>Crash notification did not appear per expected results of test.</ref>
| |
| | {{result|fail}} <ref>Python exception did not invoke abrt-gui per expected results of test. Many SELinux denials on python may have effected test.</ref>
| |
| | {{result|fail}} <ref>Kernel panic not caught by abrt. This could be due to significant SELinux denials. Kdump was difficult to configure on FC18.</ref>
| |
| | <references/> | | | <references/> |
| |- | | |- |
Line 296: |
Line 182: |
| ! [[QA:Testcase Libreport sealert|sealert]] | | ! [[QA:Testcase Libreport sealert|sealert]] |
| ! [[QA:Testcase Libreport anaconda|anaconda]] | | ! [[QA:Testcase Libreport anaconda|anaconda]] |
| ! [[QA:Testcase Libreport Anaconda Install|anaconda install]]
| |
| ! [[QA:Testcase Libreport firstboot|firstboot]] | | ! [[QA:Testcase Libreport firstboot|firstboot]] |
| ! [[QA:Testcase Retrace Server CLI|Retrace cli]] | | ! [[QA:Testcase Retrace Server CLI|Retrace cli]] |
Line 302: |
Line 187: |
| ! References | | ! References |
| |- | | |- |
| | [[User:dkutalek|David Kutalek]] | | | [[User:SampleUser|Sample User]] |
| | {{result|pass}} <ref>Tested appending to existing bug - works with minor issue {{bz|864891}}</ref> | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|pass}} <ref>client could handle corrupted problem dir better {{bz|861996}}</ref>
| |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | <references/>
| |
| |-
| |
| | [[User:jskarvad|Jaroslav Skarvada]]
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Error not catched.</ref>
| |
| | N/A
| |
| | {{result|fail}} <ref>No crash but following error message: only root can do this</ref>
| |
| | {{result|pass}} <ref>Probably not a good practice to notify user about wrong password.</ref>
| |
| | {{result|pass}}
| |
| | <references/>
| |
| |-
| |
| | [[User:Adamjosephcook|Adam Joseph Cook]]
| |
| | {{result|pass}}
| |
| | {{result|warn||861973}} <ref>Passes test if abrt reporting is run twice per bug report.</ref>
| |
| | {{result|fail}} <ref>Ran test in VM. anaconda crashed with 'kill -USR1 <pid>', however, no mechanism to report problem available.</ref>
| |
| | {{result|fail}} <ref>firstboot will not crash - 'only root can do this' is returned to console.</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | <references/> | | | <references/> |
| |- | | |- |
| |} | | |} |
|
| |
|
| == Long comments ==
| | [[Category:Test Days]] |
| <references group="long" />
| |
| | |
| [[Category:Fedora 18 Test Days]]
| |