No edit summary |
(add results from app, revise some extremely long comments) |
||
(26 intermediate revisions by 8 users not shown) | |||
Line 14: | Line 14: | ||
== What to test? == | == What to test? == | ||
Today's installment of Fedora Test Day will focus on testing '''Fedora Media Writer ''' for different | Today's installment of Fedora Test Day will focus on testing the rewritten and updated LiveUSB Creator tool, now known as [[Changes/LUCasPrimaryDownloadable|'''Fedora Media Writer''']], for different operating systems and architectures. The new tool is intended to be provided as the primary download option for Fedora 24 Workstation, with the aim of lowering the barrier for potential users to try and install Fedora. | ||
== Who's available == | == Who's available == | ||
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ... | The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ... | ||
* Development - [[User: | * Development - [[User:Eischmann|Jiří Eischmann ]] (Eischmann), [[User:Mbriza|Martin Bříza ]] (Mbriza) | ||
* Quality Assurance - [[User:Adamwill|Adam Williamson ( | * Quality Assurance - [[User:Adamwill|Adam Williamson]] (adamw), [[User:pschindl|Petr Schindler]] (pschindl), [[User:Sumantrom|Sumantro Mukherjee]] (sumantro), [[User:Achembar|Arvind Chembarpu]] (achembar) | ||
== Prerequisite for Test Day == | == Prerequisite for Test Day == | ||
{{admon/warning|Data loss|Any data on the USB stick used for this test is likely to be destroyed. Please do not use a stick whose contents you need to keep.}} | |||
* | * USB flash drive (min. 4GiB) | ||
* Root | * Root access on the system used to write the drive (or admin access in Windows) | ||
* | * The latest version of the tool (see next section) | ||
== How to test? == | == How to test? == | ||
=== | === Install the tool === | ||
* Fedora : {{command|1=sudo dnf --enablerepo=updates-testing --refresh --best install liveusb-creator}} | |||
* Windows: Download [https://mbriza.fedorapeople.org/liveusb-creator.zip liveusb-creator.zip], extract it, and run the executable | |||
=== | === Run the tests === | ||
Visit the [http://testdays.fedorainfracloud.org/events/6 result page] and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the ''Enter result'' button for the test. | |||
=== | === Exploratory testing === | ||
If you run out of test cases, congratulations! But that's not the end! You can still help out by playing around with the tool in whatever ways you can think of: try out all the things you can find, and try writing different Fedora images with it. If you have systems with different Windows versions, try running the tool on all of them. Get creative! Any problems you find please file a bug, or report to the IRC channel. | |||
== | == Reporting bugs == | ||
Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day: | |||
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=24&component=liveusb-creator liveusb-creator]. Please also make the bug 'block' the [https://bugzilla.redhat.com/show_bug.cgi?id=1310542 tracker bug for issues with the tool], by putting '1310542' in the '''Blocks:''' field. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. | |||
== Test Results == | |||
=== Fedora 24 changes === | |||
{| | |||
! User | |||
! Profile | |||
! [http://fedoraproject.org/wiki/Changes/LUCasPrimaryDownloadable LUCasPrimaryDownloadable] | |||
! References | |||
|- | |||
| [[User:bfahr|bfahr]] | |||
| Windows 7 Pro SP1 64 bit i7-4700mq | |||
| {{result|fail}}<ref>Windows admin permission prompt came up and requested permission to run windows dispart.exe. Once approved a windows dos box with diskpart comes up and is waiting for input to proceed. This happened after I had clicked on the write button.</ref> | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| Fedora Workstation x64 (first boot option) | |||
| {{result|pass}}<ref>Host: i7-3770 CPU @ 3.40GHz with 16 GB of RAM | |||
command to boot: $ qemu-system-x86_64 -boot d -cdrom /dev/sdb -m 1G</ref> | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| Windows 10 | |||
| {{result|pass}}<ref>Host: i7-3770 CPU @ 3.40GHz with 16 GB of RAM | |||
command to boot: $ qemu-system-x86_64 -boot d -cdrom /dev/sdb -m 2G </ref> | |||
| <references/> | |||
|- | |||
| [[User:deaddrift|deaddrift]] | |||
| Windows 7 Home Premium - SP1, 64bit i5-2310 | |||
| {{result|fail}}<ref>Crashed with "This is most likely caused by not having the necessary graphics drivers installed" error</ref> | |||
| <references/> | |||
|- | |||
| [[User:fmiz|fmiz]] | |||
| Windows 10 | |||
| {{result|pass}}<ref>On Windows 10 Smartscreen protection blocks execution of liveusb-creator.exe, ignoring that I left the tool to download and also checked the option to have the image written to the usb flash as soon as download was done. Boot works fine with BIOS mode, UEFI mode and SecureBoot enabled.</ref> | |||
| <references/> | |||
|- | |||
| [[User:lsatenstein |lsatenstein ]] | |||
| dumb end user | |||
| {{result|fail}}<ref>{{bz|1310542}} F23 experience. Download testing live games. | |||
Notes: No indicator on main screen when download is under way, allows double download attempt, crashes. No download location information or option. Switching to/from the main to secondary window causes live-creator to crash. | |||
</ref> | |||
| <references/> | |||
|- | |||
| [[User:renault|renault]] | |||
| F23 Workstation 64 bits | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:renault|renault]] | |||
| F23 Workstation 64 bits with BIOS laptop | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:roger.k.wells|roger.k.wells]] | |||
| Fedora 23, 64bit | |||
| {{result|pass}}<ref>No feedback when installing OS to USB drive, the progress indicator never changed. I was just about to kill it when it completed. The USB stick that I used has no activity indicator. | |||
Excessive CPU load when liveusb-creator is running, ~150% at all times after first activity. | |||
The end result seemed to work well though.</ref> | |||
| <references/> | |||
|- | |||
| [[User:satellit|satellit]] | |||
| f23 x86-64 cinnamon 2.8.7 kernel: 4.4.6-301.fc23.x86_64 Bios boot (not tested in Windows) | |||
| {{result|pass}}<ref>worked in f23 also https://wiki.sugarlabs.org/go/File:LUC_f23.png</ref> | |||
| <references/> | |||
|- | |||
| [[User:sumantro|sumantro]] | |||
| F23 Workstation 64 bits | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:sumantro|sumantro]] | |||
| F23 x86-64 design studio | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:superM|superM]] | |||
| - | |||
| {{result|warn}}<ref>No persistence?? Didn't even tried it. Unfortunately, staying with F23 (created with liveUSB Creator).</ref> | |||
| <references/> | |||
|- | |||
|} | |||
=== Basic tests === | |||
{| | {| | ||
! User | ! User | ||
! | ! Profile | ||
! [ | ! [http://fedoraproject.org/wiki/QA:Testcase_Fedora_Media_Writer_basic Basic (Fedora)] | ||
! [ | ! [http://fedoraproject.org/w/index.php?title=QA:Testcase_Fedora_Media_Writer_basic_windows Basic (Windows)] | ||
! References | ! References | ||
|- | |- | ||
| [[User: | | [[User:Ayan|Ayan]] | ||
| {{result| | | Ayan Choudhury | ||
| | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:Karthik Subrahmanya|Karthik Subrahmanya]] | |||
| Fedora22 | |||
| {{result|pass}}<ref>LGTM</ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:achembar|achembar]] | |||
| Fedora 22 | |||
| {{result|pass}} | |||
| | |||
| <references/> | |||
|- | |||
| [[User:arehtykitna|arehtykitna]] | |||
| Windows 8.1 Pro Update 1 64-bit creating F23 Cinnamon 64-bit media | |||
| | |||
| {{result|pass}}<ref>Works fine. Nice GUI layout. The alternate options icon needs to be a little more obvious what it is. It looks like a panel grab handle. Please make it resemble a menu button e.g. firefox/chrome or android...</ref> | |||
| <references/> | |||
|- | |||
| [[User:cmurf|cmurf]] | |||
| | |||
| | |||
| {{result|fail}}<ref>{{bz|1328560}} {{bz|1328563}} crashes when ISO is on a (samba) file server; continuously flashing light on USB stick; </ref> | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| DragonflyBSD (dfly-x86_64-4.4.3_REL) ( .img ) | |||
| {{result|fail}}<ref>it comes from an .img file. Not sure if the creator can handle this.</ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| DragonflyBSD (dfly-x86_64-4.4.3_REL) ( .iso ) | |||
| {{result|pass}}<ref>Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz , 16 GB RAM | |||
$ sudo qemu-system-x86_64 -boot d -cdrom /dev/sdb -m 2G </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| GhostBSD10.1-RELEASE-20150912-mate-i386 | |||
| {{result|pass}}<ref>Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz , 16 GB RAM | |||
sudo qemu-system-x86_64 -boot d -cdrom /dev/sdb -m 2G</ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| Mgeia 5 beta 1 | |||
| {{result|pass}}<ref>Host: i7-3770 CPU @ 3.40GHz with 16 GB of RAM | |||
command to boot: $ qemu-system-x86_64 -boot d -cdrom /dev/sdb -m 1G </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| PC BSD 10.3-RELEASE-03-31-2016-x64-DVD | |||
| {{result|pass}}<ref>Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz , 16 GB RAM | |||
$ sudo qemu-system-x86_64 -boot d -cdrom /dev/sdb -m 2G </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:cpanceac|cpanceac]] | |||
| Windows 10 | |||
| {{result|fail}}<ref>{{bz|1328794}} the stick is created fine (?: i have yet to test the actual installability) but the USB stick that was created is no longer "seen" by the creator</ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:deaddrift|deaddrift]] | |||
| F23 - 64bit i5-2310 | |||
| {{result|warn}}<ref>Due to the fact that you can not select a different mirror and the one it selects runs at glacial speeds, this test was aborted. </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:deaddrift|deaddrift]] | |||
| Windows 7 Home Premium - SP1, 64bit i5-2310 | |||
| | |||
| {{result|fail}}<ref>liveusb-creator.exe failed to run with OpenGL errors</ref> | |||
| <references/> | |||
|- | |||
| [[User:frantisekz|frantisekz]] | |||
| frantisekz | |||
| {{result|pass}}<ref>Bugs reported to Github: | |||
https://github.com/lmacken/liveusb-creator/issues/45 | |||
https://github.com/lmacken/liveusb-creator/issues/44 | |||
https://github.com/lmacken/liveusb-creator/issues/43</ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:jsedlak|jsedlak]] | |||
| Windows 10 64bit | |||
| | |||
| {{result|fail}}<ref>{{bz|1328484}} </ref> | |||
| <references/> | |||
|- | |||
| [[User:juliuxpigface|juliuxpigface]] | |||
| Fedora 23 Workstation | |||
| {{result|fail}}<ref>{{bz|1318491}} {{bz|1328337}} </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:kparal|kparal]] | |||
| | |||
| {{result|fail}}<ref>{{bz|1329611}} </ref>{{result|fail}}<ref>{{bz|1329608}} </ref>{{result|warn}}<ref>{{bz|1328789}} </ref>{{result|fail}}<ref>{{bz|1328498}} </ref>{{result|warn}}<ref>{{bz|1328462}} </ref>{{result|fail}}<ref>{{bz|1328457}} </ref>{{result|fail}}<ref>{{bz|1328452}} </ref>{{result|fail}}<ref>{{bz|1328369}} </ref>{{result|fail}}<ref>{{bz|1328337}} </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:lbrabec|lbrabec]] | |||
| Fedora 24 Workstation 64bit | |||
| {{result|fail}}<ref>{{bz|1328340}} </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:priynag|priynag]] | |||
| F22 Workstation 64 bits | |||
| {{result|pass}} | | {{result|pass}} | ||
| | | | ||
| <references/> | | <references/> | ||
|- | |||
| [[User:pschindl|pschindl]] | |||
| Fedora 24 Workstation 64bit | |||
| {{result|fail}}<ref>{{bz|1328369}} </ref>{{result|fail}}<ref>{{bz|1328337}} </ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:qqqqqqq|qqqqqqq]] | |||
| Windows 10 Pro | |||
| | |||
| {{result|fail}}<ref>When I click "Write to disk" it prompts me for administrator credentials. I enter them and a diskpart.exe windows opens and does nothing. | |||
output from liveusb-creator.exe: | |||
file:///C:/Users/robert.s/Desktop/liveusb-creator/qml/QtQuick/Controls/ComboBox.qml:560:5: QML Menu: Binding loop detected for property "__selectedIndex" | |||
file:///C:/Users/robert.s/Desktop/liveusb-creator/qml/QtQuick/Controls/Private/ScrollViewHelper.qml:186:9: QML Binding: Property 'raised' does not exist on Item. | |||
file:///C:/Users/robert.s/Desktop/liveusb-creator/qml/QtQuick/Controls/Private/ScrollViewHelper.qml:137:9: QML Binding: Property 'raised' does not exist on Item. | |||
[gui:213] 'Logger' object is not callable | |||
Traceback (most recent call last): | |||
File "liveusb\gui.py", line 209, in run | |||
File "liveusb\gui.py", line 219, in ddImage | |||
File "liveusb\creator.py", line 602, in dd_image | |||
TypeError: 'Logger' object is not callable | |||
qrc:/components/DownloadDialog.qml:82: ReferenceError: cross is not defined | |||
qrc:/components/DownloadDialog.qml:81: ReferenceError: cross is not defined | |||
[gui:213] 'Logger' object is not callable | |||
Traceback (most recent call last): | |||
File "liveusb\gui.py", line 209, in run | |||
File "liveusb\gui.py", line 219, in ddImage | |||
File "liveusb\creator.py", line 602, in dd_image | |||
TypeError: 'Logger' object is not callable | |||
qrc:/components/DownloadDialog.qml:82: ReferenceError: cross is not defined | |||
qrc:/components/DownloadDialog.qml:81: ReferenceError: cross is not defined | |||
</ref> | |||
| <references/> | |||
|- | |||
| [[User:renault|renault]] | |||
| F23 Workstation 64 bits | |||
| {{result|pass}} | |||
| | |||
| <references/> | |||
|- | |||
| [[User:renault|renault]] | |||
| F23 Workstation 64 bits with BIOS laptop | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:roger.k.wells|roger.k.wells]] | |||
| Fedora 23, 64bit | |||
| {{result|pass}}<ref>I am a current F23 user and there were no surprises/disappointments when booting from the USB memory stick</ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:satellit|satellit]] | |||
| | |||
| {{result|warn}}<ref>not tested</ref>{{result|pass}}<ref>bios boot f24 KDE :5.6.2 QT:5.6.0 Kernel 4.5.0-302.fc24x86_64 | |||
live install fully updated</ref> | |||
| | |||
| <references/> | |||
|- | |||
| [[User:sayak|sayak]] | |||
| F23 Workstation 64 bits | |||
| {{result|pass}} | |||
| | |||
| <references/> | |||
|- | |||
| [[User:sumantro|sumantro]] | |||
| F22 Workstation 64 bits | |||
| {{result|pass}} | |||
| | |||
| <references/> | |||
|- | |||
| [[User:sumantro|sumantro]] | |||
| F23 Workstation 64 bits | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:sumantro|sumantro]] | |||
| Windows 8.1 & Windows 10 64 bits | |||
| | |||
| {{result|pass}} | |||
| <references/> | |||
|- | |||
| [[User:swarnava|swarnava]] | |||
| | |||
| {{result|pass}} | |||
| | |||
| <references/> | |||
|- | |- | ||
|} | |} | ||
[[Category:Fedora 24 Test Days]] | [[Category:Fedora 24 Test Days]] |
Latest revision as of 23:46, 28 September 2016
Fedora Test Days | |
---|---|
Changes/LUCasPrimaryDownloadable | |
Date | 2016-04-19 |
Time | all day |
Website | [website] |
IRC | #fedora-test-day (webirc) |
Mailing list | test |
What to test?[edit]
Today's installment of Fedora Test Day will focus on testing the rewritten and updated LiveUSB Creator tool, now known as Fedora Media Writer, for different operating systems and architectures. The new tool is intended to be provided as the primary download option for Fedora 24 Workstation, with the aim of lowering the barrier for potential users to try and install Fedora.
Who's available[edit]
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
- Development - Jiří Eischmann (Eischmann), Martin Bříza (Mbriza)
- Quality Assurance - Adam Williamson (adamw), Petr Schindler (pschindl), Sumantro Mukherjee (sumantro), Arvind Chembarpu (achembar)
Prerequisite for Test Day[edit]
- USB flash drive (min. 4GiB)
- Root access on the system used to write the drive (or admin access in Windows)
- The latest version of the tool (see next section)
How to test?[edit]
Install the tool[edit]
- Fedora :
sudo dnf --enablerepo=updates-testing --refresh --best install liveusb-creator
- Windows: Download liveusb-creator.zip, extract it, and run the executable
Run the tests[edit]
Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.
Exploratory testing[edit]
If you run out of test cases, congratulations! But that's not the end! You can still help out by playing around with the tool in whatever ways you can think of: try out all the things you can find, and try writing different Fedora images with it. If you have systems with different Windows versions, try running the tool on all of them. Get creative! Any problems you find please file a bug, or report to the IRC channel.
Reporting bugs[edit]
Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:
If you have problems with any of the tests, report a bug to Bugzilla usually for the component liveusb-creator. Please also make the bug 'block' the tracker bug for issues with the tool, by putting '1310542' in the Blocks: field. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.
Test Results[edit]
Fedora 24 changes[edit]
User | Profile | LUCasPrimaryDownloadable | References |
---|---|---|---|
bfahr | Windows 7 Pro SP1 64 bit i7-4700mq |
| |
cpanceac | Fedora Workstation x64 (first boot option) |
| |
cpanceac | Windows 10 |
| |
deaddrift | Windows 7 Home Premium - SP1, 64bit i5-2310 |
| |
fmiz | Windows 10 |
| |
lsatenstein | dumb end user | ||
renault | F23 Workstation 64 bits | ||
renault | F23 Workstation 64 bits with BIOS laptop | ||
roger.k.wells | Fedora 23, 64bit |
| |
satellit | f23 x86-64 cinnamon 2.8.7 kernel: 4.4.6-301.fc23.x86_64 Bios boot (not tested in Windows) |
| |
sumantro | F23 Workstation 64 bits | ||
sumantro | F23 x86-64 design studio | ||
superM | - |
|
Basic tests[edit]
User | Profile | Basic (Fedora) | Basic (Windows) | References |
---|---|---|---|---|
Ayan | Ayan Choudhury | |||
Karthik Subrahmanya | Fedora22 |
| ||
achembar | Fedora 22 | |||
arehtykitna | Windows 8.1 Pro Update 1 64-bit creating F23 Cinnamon 64-bit media |
| ||
cmurf | ||||
cpanceac | DragonflyBSD (dfly-x86_64-4.4.3_REL) ( .img ) |
| ||
cpanceac | DragonflyBSD (dfly-x86_64-4.4.3_REL) ( .iso ) |
| ||
cpanceac | GhostBSD10.1-RELEASE-20150912-mate-i386 |
| ||
cpanceac | Mgeia 5 beta 1 |
| ||
cpanceac | PC BSD 10.3-RELEASE-03-31-2016-x64-DVD |
| ||
cpanceac | Windows 10 | |||
deaddrift | F23 - 64bit i5-2310 |
| ||
deaddrift | Windows 7 Home Premium - SP1, 64bit i5-2310 |
| ||
frantisekz | frantisekz | |||
jsedlak | Windows 10 64bit | |||
juliuxpigface | Fedora 23 Workstation | |||
kparal | ||||
lbrabec | Fedora 24 Workstation 64bit | |||
priynag | F22 Workstation 64 bits | |||
pschindl | Fedora 24 Workstation 64bit | |||
qqqqqqq | Windows 10 Pro |
| ||
renault | F23 Workstation 64 bits | |||
renault | F23 Workstation 64 bits with BIOS laptop | |||
roger.k.wells | Fedora 23, 64bit |
| ||
satellit | ||||
sayak | F23 Workstation 64 bits | |||
sumantro | F22 Workstation 64 bits | |||
sumantro | F23 Workstation 64 bits | |||
sumantro | Windows 8.1 & Windows 10 64 bits | |||
swarnava |