Fedora Test Week | |
---|---|
GNOME 43 Beta | |
Date | 2022-08-15 to 2022-08-21 |
Time | all day |
Website | QA/Test Days |
IRC | #fedora-test-day (webirc) |
Mailing list | test |
What to test?[edit]
This Fedora Test Week will focus on GNOME 43 Beta
Who's available?[edit]
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
- Development - Kalev Lember (kalev), Allan Day (aday)
- Quality Assurance - Adam Williamson (adamw), Sumantro Mukherjee (sumantrom), Kamil Páral (kparal), coremodule (coremodule)
Prerequisites for Test Day[edit]
- Fedora 37 Workstation nightly ISO image with GNOME 43.beta installed on either bare metal or in a virtual machine. (Make sure you have no important data on that installation. Things might go wrong -- don't do this on your production machine!)
- If you already have Fedora 37 Workstation installed, there's no need to reinstall, but just make sure you have the latest updates installed.
- Enough free disk space
Files Nightly Builds[edit]
The Files nightly flatpak can be a useful way to test, since this allows running the new version of the file manager on an existing Fedora 36 installation. To install it, run the following in the terminal:
flatpak remote-add --if-not-exists gnome-nightly https://nightly.gnome.org/gnome-nightly.flatpakrepo
flatpak install org.gnome.NautilusDevel
Known bugs with this Flatpak compared with the packaged version:
- In the open with dialog, the full list of apps isn't available
These issues can be safely ignored when testing.
How to test?[edit]
Run the tests[edit]
Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.
Test the new features[edit]
Fedora 37 and GNOME 43 include a number of new features that would benefit from testing. These include:
- Redesigned system status menu
- This can be accessed from the top bar, where the system status icons are
- This feature is best tested using a bare metal installation, due its high level of hardware integration
- Things to focus on:
- Do each of the toggle buttons work as expected?
- Can you perform your usual connectivity tasks: connect to Wi-Fi, Bluetooth, VPN, Bluetooth tethers, USB tethers.
- Files (nautilus) GTK 4 port
- The default file manager has been ported to GTK 4 for GNOME 43. This is primarily a technical change, but there have been a large number of small design changes also.
- This feature is best tested through ongoing dog fooding: can you use the new Files version as your daily file manager? Does it perform well with the files and folders that you typically interact with?
- In addition to testing using the Fedora 37 package, it is also possible to test using the nightly Flatpak (see above).
- Initial setup GTK 4 port
- Software sources dropdown
- This dropdown is now located below the install/open/remove button on each app page
- To test this, try adding a few different types of app repository, and see how it looks and behaves for different applications
Do exploratory testing[edit]
Use the latest Fedora 37 Workstation that includes GNOME 43.beta and see if you can find anything that's crashing or not working correctly. In that case, file a bug!
Reporting bugs[edit]
We have two separate places to file bugs. First, downstream in Fedora bug tracker. This is mostly useful for issues with packaging and for issues that need tracking downstream (blocker bugs for F37): Red Hat Bugzilla.
Second, there's upstream GNOME Gitlab that's useful for issues that are likely not Fedora-specific. If you file an issue downstream that looks like it needs a code fix, please file it upstream as well, to make sure all relevant people get notified of the issue.
If you are unsure about exactly how to file the report or what other information to include, just ask on IRC #fedora-test-day or #fedora-qa and we will help you.
Test Results[edit]
Basic[edit]
User | Profile | Gnome Accessibility | Gnome Classic mode | Gnome Initial Setup | Gnome Lock Screen | Gnome Login Screen | Gnome Music | Gnome Web | Desktop update notification | Gnome Files | Gnome Software | Evince File Display | References |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Geoffrey Gordon Ashbrook |
| ||||||||||||
Geoffrey Gordon Ashbrook | dell inspiron laptop live iso | ||||||||||||
aeitcpopce | QEMU VM, Intel i5-9300H (8) @ 2.400GHz 8GB RAM | ||||||||||||
andilinux | GNOME BOXES |
| |||||||||||
andilinux | GNOME BOXES - F37 | ||||||||||||
bittin | Virtualbox | ||||||||||||
bittin | Virtualbox | ||||||||||||
bmilar | Dell Precision 3551 | ||||||||||||
couchfox | Dell Inspiron 7577 (bare metal) | ||||||||||||
domcox | bare metal | ||||||||||||
ernmander | |||||||||||||
ernmander | Bare Metal |
| |||||||||||
freddyw | VIrtualBox | ||||||||||||
frosetrain | GNOME Boxes |
| |||||||||||
frosetrain | frosetrain | ||||||||||||
geraldosimiao | x86_64 KVM virt-manager UEFI | ||||||||||||
heliosstyx | |||||||||||||
heliosstyx | heliosstyx |
| |||||||||||
hricky | Intel® Core™ i7-4790 CPU, 32 GB RAM, Bare Metal | ||||||||||||
hricky | Intel® Core™ i7-4790 CPU, 32 GB RAM, Bare Metal, Fedora Linux 37.20220820.n.0 (Silverblue Prerelease) | ||||||||||||
jakfrost | QEMU/KVM - Virt-Manager | ||||||||||||
mairacanal | F37 Workstation on Intel i5-4460 CPU with Radeon RX5700 XT |
| |||||||||||
mmmarkkk | Gnome Boxes on HP Elitebook 840 G8 | ||||||||||||
modehnal | Local VM from ISO |
| |||||||||||
modehnal | Local VM instlaled from ISO | ||||||||||||
mpearson | X1 Yoga G7 | ||||||||||||
naraiank | VMWare workstation 16 Player |
| |||||||||||
pnemade | KVM | ||||||||||||
pratajo | HP Victus notebook with AMD Ryzen 5 5600H and Radeon Graphics |
| |||||||||||
remyabel | libvirt | ||||||||||||
tpelka | local VM | ||||||||||||
user | bare metal, Gigabyte Technology Co., Ltd. GA-880GM-UD2H, Fedora Linux 37 (Workstation Edition Prerelease), 64-bit | ||||||||||||
vbudikov | |||||||||||||
vbudikov | Lenovo T470S | ||||||||||||
vhumpa | VM |
| |||||||||||
vhumpa | qemu-kvm qxl/spice |
|
Gnome Shell[edit]
User | Profile | Activities | Extensions | Dash | Extensions gnome org | Extensions install | Extensions remove | Extensions tweak tool | Overview Search | Workspaces | References |
---|---|---|---|---|---|---|---|---|---|---|---|
andilinux | GNOME BOXES | ||||||||||
bittin | Virtualbox |
| |||||||||
bmilar | Dell Precision 3551 | ||||||||||
couchfox | Dell Inspiron 7577 | ||||||||||
domcox | bare metal | ||||||||||
freddyw | VIrtualBox | ||||||||||
heliosstyx | bare metal | ||||||||||
hricky | Intel® Core™ i7-4790 CPU, 32 GB RAM, Bare Metal | ||||||||||
mairacanal | F37 Workstation on Intel i5-4460 CPU with Radeon RX5700 XT |
| |||||||||
modehnal | Local VM from ISO | ||||||||||
mpearson | X1 Yoga G7 | ||||||||||
pnemade | KVM | ||||||||||
remyabel |
Gnome Online Accounts[edit]
User | Profile | Add Google | Add IMAP and SMTP | Add Kerberos | Add ownCloud | References |
---|---|---|---|---|---|---|
andilinux | GNOME BOXES | |||||
couchfox | Dell Inspiron 7577 |
| ||||
domcox | bare metal | |||||
freddyw | VIrtualBox | |||||
heliosstyx | bare metal |
| ||||
hricky | Intel® Core™ i7-4790 CPU, 32 GB RAM, Bare Metal | |||||
mairacanal | F37 Workstation on Intel i5-4460 CPU with Radeon RX5700 XT | |||||
modehnal | Local VM from ISO |
Disk Management[edit]
User | Profile | Basic | Modify | References |
---|---|---|---|---|
andilinux | GNOME BOXES | |||
bittin | Virtualbox | |||
bittin | Virtualbox | |||
bmilar | Dell Precision 3551 | |||
couchfox | Dell Inspiron 7577 | |||
domcox | bare metal | |||
freddyw | VIrtualBox | |||
geraldosimiao | x86_64 KVM virt-manager UEFI |
| ||
heliosstyx | bare metal | |||
hricky | Intel® Core™ i7-4790 CPU, 32 GB RAM, Bare Metal | |||
mairacanal | F37 Workstation on Intel i5-4460 CPU with Radeon RX5700 XT | |||
mmmarkkk | Gnome Boxes on HP Elitebook 840 G8 | |||
modehnal | Local VM from ISO | |||
pnemade | KVM |
Exploratory Testing[edit]
User | Profile | Exploratory Testing | References |
---|---|---|---|
aday | Boxes | ||
alciregi | Intel NUC 7i5BNH |
| |
bittin | Virtualbox |
| |
bmilar | Dell Precision 3551 |
| |
couchfox | Dell Inspiron 7577 (bare metal) | ||
domcox | bare metal | ||
heliosstyx | bare metal |
| |
mairacanal | F37 Workstation on Intel i5-4460 CPU with Radeon RX5700 XT |
| |
modehnal | Local VM instlaled from ISO |
| |
mpearson | X1 Yoga G7 |
Long comments[edit]
- ↑ 1. screen keyboard was very very delayed (I thought it didn't work at all) but then the toggle button froze-glitched and will not be toggled. bug; 2: maybe relating to the screen keyboard issue: the dash will NOT come up at all now, either with 3-fingers up on the track pad or a mouse in the upper left of the screen...very bad. very broken.
- ↑ I have no idea what the instructions page is saying to do. No goal, no steps...what are you asking for? https://fedoraproject.org/wiki/QA:Testcase_Gnome_Classic_mode You say to installl...what how? Is it there, it isn't there? It isn't there but I should test it? What are you talking about?
- ↑ You should see actual time and date: yes Screen should unlock: NO: any mouse or key simply goes back to the normal session with a glitchy blink Screen should stay locked and show error message: NO, neither "Log in as another user" option does not exist Screen should turn off and lock after configured time. ...what? Notifications should be visible on locked screen: no data on this
- ↑ What do you mean by "Gnome Music"? Rhythm-box? There are two 'music' apps in the software installer. What are you asking me to test? Anyting? Speakers? Rhythm box works...so far.
- ↑ I opened a pdf with the default software IF that is what you meant. What is Evince? Please be clear about what you are talking about and get the names of your applicates straight. e.g. I can't even use the default gnome editor from command line because there's no way to find out all the disparate names the get used and printed.
- ↑ somewhat works but update tab does nothing, has software, tried downloading and running endless sky but got error: unable to initialize GLEW! tried installing Enigma, that worked after seeming to freeze during download.
- ↑ Worked well. It would be nice if the accessibility menu didn't close after every toggle, and also if it provided some shortcut to the accessibility settings pane.
- ↑ Large Text, Cursor Size, Zoom, Screen Keyboard, Click Assist all work as expected. Did not experience Screen Keyboard lag reported elsewhere.
- ↑ Tested both RPM and Flatpak, works as expected for local files. As noted elsewhere the
-d
for debug does not work. I could not follow the instructions regarding remote files... if Music supports UPnP sources I can't see how :) - ↑ Preferences -> "Navigate folders in a tree" does not exist. Suspect the test case is out of date, as Files 42.0 on F36 is the same; no regression.
- ↑ Click and move the mouse pointer using the keypad: If I log out then log in again, the option is still activated, but using the Num keyboard for moving the mouse doesn't work anymore.
- ↑ Pressing the ?123 key in the virtual keyboard activates the num keys at the top of the keyboard, but if I press one of these keys, for example '2', I randomly get '2' or '~', the underlying character.
- ↑ Either way I lock the screen, I see the lock screen half a second, then the screen goes black, I have to hit the keyboard to see actual time and date again.
- ↑ Checking properties on files displayed in the "recent" place, bring the message: Unknown Permissions The permissions of the selected files could not be determined.
- ↑ as mentioned by others, installing rpm's does not work, flatpaks are fine. OS updates not working either, seeing "Failed to get cache filename" in the journal and "PKI file /etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-39-primary is not a public key".
- ↑ I then forcefully shut down the virtual machine and started it again, but when the system was booting, it got stuck on the loading screen with the Fedora logo. The last systemd boot message displayed was "Mounted sysroot.mount".
- ↑ This test was not performed because the **only user** on the system did not have administrator privileges, and so could not create new user accounts. I then attempted to restart the system, but because the only user did not have admin, I was only able to log out. Upon logging back in, I realised that all my apps, both in the Dock and in the app menu, were gone. Even trying to launch Settings from the top-right corner menu did not work.
- ↑ At Live-x86_64-37-20220815.n.0.iso, even with google repo enabled, didn't get to install chrome from gnome-software, get the "chrome doesn't have support" message.
- ↑ There seems to be no debug option (gnome-music -d) as described in How to test. Music files in ~/Downloads are not displayed. In Playlists tab "Never Played" shows recently played, but "Recently Played" is empty.
- ↑ Always show accessibility menu should be on by default, it currently isn't with this during installation or after first install during setup. From an accessibility POV that's a blocker.
- ↑ - Fedora Media Writer doesn´t turn into high contrast mode when toggling the high contrast. - Zoom seems blurry. - On the screen keyboard, every time I click on a word suggestion, the word gets deleted. Every time I click enter, also the word gets deleted. When I disabled the screen keyboard, all input fields remain broken (they were just fine before).
- ↑ After suspending it (through the user menu) and going back to my user, all applications disappeared from the menu. When searching for an application, no app is shown also. When switching between users, the screen freezes.
- ↑ Epiphany crashed when watching previews on YouTube (a single tab open). Also, music players are stacking on the notification tab even when I had already closed the video, and I can seen to find a way to delete them. Cannot add tabs to my favorites with the right click.
- ↑ Screen Keyboard has different layout for Terminal that changes upon click (losing some buttons). I am not seeing this layout in Shell Overview or in Text Editor. Slow Keys do not trigger notification, I made no changes to the system from the installation.
- ↑ When System Menu is opened and you move cursor down to the screen over the opened panel, so that the Menu stays open -> when moving cursor over Application or Places they do not react to clicks or mouse hovers. This cannot be reproduced from other menus - Clock, Places, Applications
- ↑ Everything seems functional but I noticed a weird interaction with Settings that I did not notice on other applications. When I have Settings open and I attempt to open another Settings via Applications menu, the cursor changes to loading wheel for 10+ seconds.
- ↑ When entering a wrong password the Gear button for session type/desktop change disappears. And after that when clicking on the Back button the button reappears but I am still on the password instead on User selection.
- ↑ Lock Screen in GNOME Classic does not have outline for password entry, it blends to the background, but flashes white for a moment if I press Esc before the Screen with time shows.
- ↑ Power Off and Restart work fine but Suspend makes me lose control of the machine and virt-manager I have to kill the qemu process. I get an error: "Error shutting down domain: Requested operation is not valid: domain is not running" Might very well be issue with virt-manager.
- ↑ Login and switching users works fine but I see no Language option on login screen so even for languages set to users (CZ, FR) I need to enter password in US keyboard layout. Languages are loaded fine in users themselves. I also seem to unable to smoothly switch between logged users, it works for a time but stops working suddenly - might be the issue with virt-manager though.
- ↑ There seems to be no debug option (gnome-music -d) as described in How to test. When starting via Terminal it gives an error: "libEGL warning: DRI2: failed to authenticate"
- ↑ Youtube video will trigger multiple notification entries. Each of them can control the one video playing but only the top notification will be modified. The notifications cannot be removed unless the video is closed. Many times the Label of the notification controlling the video is not even the correct video but previous one or one I have not started at all.
- ↑ Youtube jumping to the part of the video that was not yet buffered makes youtube stop and show loading wheel, sometimes clicking back as if to the buffered part makes it start playing but a few times video was no longer playable and I had to reload the page to make the video play again.
- ↑ Notification successfully popped up. GNOME Software shows applications that were updated with Restart & Update prompt. Restart & Update did successful offline upgrade. Notification that updates were installed pops up, updated apps appear in the list.
- ↑ Installing RPM/Flatpak and uninstalling RPM/Flatpak seems to work fine. Launching Flatpak after installation seems to work fine, but not RPM. Application installed via dnf from command line does not seem to show up in Installed list. Application installed as RPM does not launch when clicking Open from GNOME Software after installation. The install button disappears until another option is selected. When installing via Flatpak, a notification about bad signing key appears
- ↑ When I lock the screen, I see the lock screen half a second, then the screen goes black, I have to hit the keyboard to see actual time and date again.
- ↑ Screen reader does not read correctly. It skipped parts, e.g. when I change toggle button from on to off it does not read this or when I open Typing Assist dialog, it does not read everything.
- ↑ When I lock the screen, I see the lock screen half a second, then the screen goes black, I have to hit the keyboard to see actual time and date again.
- ↑ (Test case needs an update for gnome-extensions-app) No extensions can be installed via gnome-software at this time. I installed some extensions via DNF, however, those extensions then do not appear in gnome-extensions-app; only the built-in extensions are listed. The extensions themselves generally do not function -- I assume it is a bit early for third-party extensions.
- ↑ installed the flatpak version from flathub. Needed to logout/login to make it work. The flatpak 'com.mattjakeman.ExtensionManager' seems to do a better job however.
- ↑ no extensions on gnome.org extensions for Gnome 43 Beta. Some extensions from the Fedora RPM does not work, they should be removed or updated.
- ↑ Extension application can manipulate installed extensions. Background Logo extension is incompatible with the current GNOME version. Gnome extensions listed in Software could not be installed ("Unable to find ..."). I can't manage to install from extensions.gnome.org.
- ↑ Going back to the main page and browsing through available extensions I didn't see any previously installed (not using web interface) extension.
- ↑ While Extension application can manipulate with extensions just fine. Searching for gnome-shell-extensions in Software will find some but upon clicking will show error that it was unable to find them. dnf will show some but does not enable them automatically after installation from what I can tell. I am unable to install from extensions.gnome.org
- ↑ For disks with >30 partitions, some of them do not fit in the scheme (horizontal view) and thus (having no scroller) they are hidden for the user.
- ↑ RHBZ #2119089 Device security panel temporarily visible in a VM: https://gitlab.gnome.org/GNOME/gnome-control-center/-/issues/2016 Night light unavailable info bar doesn't look very good: https://gitlab.gnome.org/GNOME/gnome-control-center/-/issues/2020 Software explore page is missing content, has an odd layout: https://bugzilla.redhat.com/show_bug.cgi?id=2119089
- ↑ RHBZ #5779 System Status menu - VPN Button: VPN connection can be toggled ON but not OFF, however, this appears to be addressed in https://gitlab.gnome.org/GNOME/gnome-shell/-/issues/5779
- ↑ After having setup a Wireguard connexion, it shows up in the new quick menu, and you can activate the connection. Once connected, you cannot deactivate it anymore. You have to rely on nmcli con down wg0.
- ↑ Happenning randomly: all applications disappear from overview and Favourites (Pin) panel, Halt and Reboot options are gone from the new Quick menu. Hitting the Halt button in the logout window launched by Ctrl+Alt+Del does nothing.
- ↑ Gnome Videos don´t open H.624 videos. When opened from Nautilus, Files doesn´t show any warning, just a blank screen. When opening an H.624 video from the Gnome Videos app, it shows a warning. This should be the expected behavior from Nautilus also.
- ↑ Settings got stuck for a few seconds when I clicked on Appearance, some error messages and stack traces appeared in journal that indicate that the object was already destroyed
- ↑ I was unable to start Extensions app from Overview but I was able to from Software. Upon closer look there are both versions installed, rpm and flatpak, but Overview showed rpm which I am unable to open even from Software that provides me with Open button.
- ↑ Happened twice already in span of a 5 minutes, when changing between GNOME Classic to GNOME, all applications disappear from overview and Favourites (Pin) panel.
- ↑ Don't know if it's a bug as I suspect it's working as designed and I just don't like the design: When disabling Bluetooth (for example) from the systray it sits there and stays lit for quite a while (enough that I thought it hasn't worked), and then the box disappears. To enable BT again I have to go into settings to turn it on. I assume the aim is to keep that systray as minimal as possible, but I found it a bit confusing. Having the audio select from there is awesome though.