Can't make the date? If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at
Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the
current schedule and see if a similar but more recent Test Day is planned or has already happened.
What to test?[edit]
Today's installment of Fedora Test Day will focus on testing
- dnf5 basic sanity (install, remove, reinstall, download)
- dnf5 downgrade / upgrade / update commands
- dnf5 makecache / clean commands
- dnf5 distro-sync / dsync
- any performance issues
Who's available[edit]
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion. Use #dnf or #fedora-test-day channels on libera chat. Alternatively, write on sst-cs-software-management@redhat.com In case of problem related to test day organization/wiki/whatever, please reach out to sumantrom.
Marek Blaha (mblaha),
David Cantrell (dcantrell),
Evan Goode (egoode),
Jan Kolárik (jkolarik),
Pavla Kratochvílová (pkratoch),
Aleš Matěj (amatej),
Jaroslav Mráček (jmracek),
Jaroslav Rohel (jrohel),
Nicola Sella (nsella)
Prerequisite for Test Day[edit]
- A system (real or virtual) you can install Fedora to, and not mind if it breaks
- A Fedora 38 image: download latest 38
How to test?[edit]
Install Fedora 38[edit]
Testing DNF from a live environment is difficult and will likely wind up with the system exhausting available RAM and failing in strange ways, so we recommend you install Fedora 38 for this Test Day.
Update your machine[edit]
Make sure you have all the current updates installed, using the update manager. Note that a clean installed Fedora 38 system will have DNF 4.14, while after update from updates-testing (which is enabled by default), you should have DNF 5 from just execute sudo dnf install dnf5 dnf5-plugins
. We are interested in tests with both versions. If you find an issue with one version, it would be very useful to check if it also happens with the other. For the reference, there is a copr repository for dnf5 which is built against upstream.
Run the tests[edit]
Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.
Reporting bugs[edit]
If you have problems with any of the tests, report a bug to Bugzilla usually for the component dnf5. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.
Known issues[edit]
- Dnf5 repoquery lists some packages twice
https://bugzilla.redhat.com/show_bug.cgi?id=2174337
- Dnf5 group list may stop listing the groups if run for a second time. To workaround, run dnf5 clean all before running dnf5 group list again.
https://bugzilla.redhat.com/show_bug.cgi?id=2173929
- It may happen that group remove doesn’t remove all packages which has been installed by group install.
https://bugzilla.redhat.com/show_bug.cgi?id=2173927
Test Results[edit]
Basic Tests[edit]
User
|
Profile
|
Sanity
|
DNF5 makecache
|
DNF5 dsync
|
DNF5 Swap
|
DNF5 repoquery
|
DNF5 updates
|
References
|
Daniels
|
QEMU Standard PC _Q35 + ICH9, 2009_ MEle Intel® Celeron® N5105 × 4 F38 WS Linux 6.2.2-301.fc38.x86_64 Gnome 44.beta KVM
|
pass [1]
|
|
|
|
|
|
- ↑ Cool Stuff: All pass for "Sanity" test.
|
Gyro
|
Fedora 38 test image inside virt-manager
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
Gyro
|
Fedora 38 test image inside virt-manager on Fedora 37
|
|
|
|
|
pass
|
|
|
Renault
|
x86_64 on Intel i5-3470 processor + nVidia 1050; fr_FR
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
VladimirSokolenko
|
QEMU emulator version 6.2.0 (qemu-6.2.0-17.fc36), Fedora-Workstation-Live-x86_64-38-20230306.n.0.iso VM image
|
pass
|
pass
|
pass
|
pass
|
pass
|
warn [1]
|
- ↑ After successful package downgrade & next update process:
sudo dnf5 update gedit
Unknown argument "update" for command "dnf5"
However, sudo dnf5 upgrade gedit works totally fine
|
alciregi
|
Fedora Server aarch64 on Raspberry Pi 4
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
andilinux
|
F38 Beta, Gnome Boxes, en_US, x86_64, Fresh Kernel 6.2.6-300.fc38.x86_64
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
bittin
|
F38 Beta - Virtualbox
|
warn
|
pass
|
pass
|
pass
|
pass pass warn [1]
|
pass
|
- ↑ [fedora38beta@fedora ~]$ dnf5 repoquery --info vim
Updating and loading repositories:
Repositories loaded.
guess this is not expected
|
bittin
|
F38 Last Pre Beta - Virtualbox
|
fail [1]
|
pass
|
pass
|
pass
|
|
pass
|
- ↑ having problems with dnf5 reinstall and download --resolve
|
condor
|
HP Elite 8300 w/ i5-3470
|
pass
|
|
|
|
|
|
|
danniel
|
F38, Libvirt VM
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
emanuelec
|
VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass [1]
|
- ↑ Used VM upgraded from v37
|
emanuelec
|
VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
emrakova
|
OpenStack virtual machine, x86_64
|
warn [1]
|
pass
|
warn [2]
|
warn [3]
|
warn [4]
|
pass [5]
|
- ↑ RHBZ #2178126 bash-completion doesn't work at all for dnf5-5.0.6-2.fc38, it works OK for dnf5-5.0.7-20230314005057.17.g160033cc.fc38
bug reported for dnf5 download
- ↑ alias dsync does not work for dnf5
- ↑ RHBZ #2178129 bug reported for dnf5 swap
- ↑ dnf5 repoquery provides duplicates when the same versions of packages are available in multiple repos, see also https://bugzilla.redhat.com/show_bug.cgi?id=2178126
- ↑ just missing update alias
|
ewilcox
|
|
pass [1]
|
pass [2]
|
pass [3]
|
|
|
|
- ↑ All tests resulted n the expected outcome as per the test page.
- ↑ All tests returned the expected outcome.
- ↑ All tests succeeded.
|
geraldosimiao
|
F38 KDE beta 1.3 - x86_64 KVM virt-manager UEFI (running on F37 KDE at Acer Aspire V3-571 / i7-3632QM)
|
pass [1]
|
pass
|
pass
|
pass [2]
|
pass
|
warn [3]
|
- ↑ dnf5-5.0.6-2.fc38.x86_64
- ↑ Swaped correctly sddm-wayland to sddm-x11 including upgrade of sddm in same transaction.
- ↑ At version dnf5-5.0.6-2 there is no "update" alias, only "upgrade". Using dnf5 upgrade all runs fine, without errors.
|
gianmichele
|
Fedora 38 KDE with updates testing enabled
|
|
|
|
|
|
warn [1]
|
- ↑ The downloaded rpm's in /var/cache/libdnf5/<repo>/packages are not removed after operation and might fill up the partition without users consent.
Output in console is very verbose compared to dnf4. "dnf5 upgrade" usually needs more than the the lines of a 1920 x 1200 tty screen.
|
hricky
|
Bare Metal, ASRock H97 Pro4-P2.10, Intel® Core™ i7-4790 × 8, 32.0 GiB RAM, Intel® HD Graphics 4600 (HSW GT2), Fedora Linux 38 (Workstation Edition Prerelease), Kernel: Linux 6.2.5-300.fc38.x86_64
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
jdg216
|
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
lbrabec
|
F38 QEMU VM aarch64
|
pass
|
pass
|
pass
|
|
|
|
|
lruzicka
|
F38, fully updated, Libvirt VM
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
markr217
|
kvm, 16G, 4 proc
|
pass
|
|
|
|
|
|
|
markr217
|
kvm, 16G, 4 proc, F38
|
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
mbanas
|
virtual F38, aarch64.
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass [1]
|
- ↑ Just the issue with update vs. upgrade.
|
mikelo2
|
podman + Raspberry Pi 3 Model B+
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
msmafra
|
https://discussion.fedoraproject.org/u/msmafra/summary
|
|
|
warn [1]
|
|
|
|
- ↑ I've been running dnf5 since F38 branched, today of all days, sudo dnf5 upgrade or distro-sync did not work.
"Transaction failed: Rpm transaction failed"
After looping with sudo dnf5 distro-sync to each individual package evince was the culprit, all other package installed without warning
|
mzink
|
F38 VM
|
pass
|
pass
|
pass
|
pass
|
pass
|
pass
|
|
rai510
|
Gnome Boxes Fedora-Workstation-Live-x86_64-38-20230313.n.0.iso
|
pass [1]
|
|
|
|
|
|
|
royboy626
|
Fedora 38 Beta Workstation;Bare Metal; x86_64;ZBOXHD-ND22
|
pass [1]
|
pass
|
pass
|
pass
|
pass
|
pass
|
- ↑ Perhaps man page should state 'download' is to pwd?
|
sgob
|
Fedora 38 in a VM, virt-manager.
|
warn [1]
|
pass
|
|
|
|
|
- ↑ Everything went fine and smooth, installing and upgrading thousands of packages. However, for instance, when installing lots of packages, lowest completion bar always reports 100%. I installed texlive-scheme-full to test it.
|
urtabajev
|
i3-3220T | 8GB
|
pass
|
|
|
|
|
|
|
Parity Tests[edit]
User
|
Profile
|
DNF5 info
|
DNF5 list
|
DNF5 history
|
DNF5 enable/disable repo
|
DNF5 search
|
DNF5 check-update
|
DNF5 assorted options
|
References
|
Renault
|
x86_64 on Intel i5-3470 processor + nVidia 1050; fr_FR
|
pass [1]
|
fail [2]
|
pass [3]
|
fail [4]
|
fail [5]
|
fail [6]
|
pass
|
- ↑ dnf5 info does not exist, used dnf repoquery --info instead
- ↑ dnf5 list does not exist
- ↑ List only transactions done with dnf5, not with dnf (and vice versa)
- ↑ dnf5 config-manager command does not exist, but being able to enable / disable repo for a specific transaction with --enablerepo argument...
- ↑ No available command dnf5 search
- ↑ No available command for dnf5 check-update
|
bittin
|
F38 Beta - Virtualbox
|
pass pass [1]
|
pass pass [2]
|
fail [3] fail [4]
|
pass
|
pass pass
|
warn [5] fail [6]
|
|
- ↑ Works with the version in copr
- ↑ Works with the version in copr
- ↑ no undo or rollback
- ↑ Rollback is having problems
- ↑ Not implemented yet
- ↑ Unknown argument "check-update" for command "dnf5"
|
bittin
|
F38 Pre Beta & Beta - Virtualbox
|
|
|
|
fail [1]
|
|
|
|
- ↑ [fedora38beta@fedora ~]$ sudo dnf5 config-manager --disable updates-testing
Unknown argument "config-manager" for command "dnf5"
|
emanuelec
|
VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
|
|
|
|
|
|
|
pass
|
|
emanuelec
|
VM ware Fusion Professional Version 13.0.1 (21139760) - MacOS 13.2.1 (22D68) host - Apple M1 Pro (aarch64)
|
warn [1]
|
warn [2]
|
pass [3]
|
warn [4]
|
warn [5]
|
warn [6]
|
|
- ↑ dnf info dnf works (as per test), but dnf5 info dnf doesnt exist
- ↑ dnf list works (as per test), but dnf5 list doesnt exist
- ↑ List only transactions done with dnf5, not with dnf (and vice versa)
- ↑ dnf5 config-manager command does not exist
- ↑ No available command dnf5 search
- ↑ No available command for dnf5 check-update
|
ewilcox
|
|
pass
|
pass
|
pass [1]
|
warn [2]
|
warn [3]
|
warn [4]
|
fail [5]
|
- ↑ --info and --last are not recognized arguments. dnf returned the usage: dnf history output.
- ↑ both 'sudo dnf config-manager --disable fedora-modular' and 'sudo dnf config-manager --enable fedora-modular' execute reporting no error. They display no confirmation message that the repository has been enabled or disabled. The only indication of success is that following execution the terminal returns to the command prompt.
- ↑ Expected Results for dnf search nemo:
The following must be true to consider this a successful test run:
The command executes without error. true
The output includes a list of packages that match the search criteria, sorted alphabetically. true
Each package listed should include the package name, a brief description, the version number, and the repository from which it is available. false (ncludes pacage name : descirption)
The output is readable and formatted correctly. true
- ↑ Expected Results
The command executes without error: true
The output includes a list of available package updates, if any, sorted by package name: none available
Each package listed should include the package name, the current version, the available version, the repository from which it is available, and a brief description of the update: none listed
If there are no available package updates, the output should indicate that no updates are available: false - no indication that no updates are available.
The output is readable and formatted correctly: true
- ↑ All dnf commands complete without error: false - sudo dnf install -y --enablerepo=epel --best nginx
Error: Unknown repo: 'epel'
The nginx, git, python3, and vim packages are installed successfully: true
The nodocs option is enabled for the nginx installation: true
The epel repository is disabled during the git installation and enabled during the nginx installation: false sudo dnf install -y --enablerepo=epel --best nginx
Error: Unknown repo: 'epel'
The latest version of nginx is installed during the nginx installation: false sudo dnf install -y --enablerepo=epel --best nginx
Error: Unknown repo: 'epel'
The $releasever value is overridden during the python3 installation: false Package python3-3.11.2-1.fc38.x86_64 is already installed.
The keepcache option is set to 1 during the vim installation: false Package vim-enhanced-2:9.0.1367-1.fc38.x86_64 is already installed.
|
geraldosimiao
|
F38 KDE beta 1.3 - x86_64 KVM virt-manager UEFI (running on F37 KDE at Acer Aspire V3-571 / i7-3632QM)
|
warn [1]
|
pass [2] fail [3] fail [4]
|
warn [5]
|
fail [6]
|
pass [7] warn [8]
|
|
|
- ↑ dnf5 have only "dnf5 repoquery --info <package>" and dnf have both methods (info and repoquery).
- ↑ dnf5 list command works fine with unstable version 5.0.7-20230315005850.23.g520edcb2 from copr
- ↑ No dnf5 list with version 5.0.7-1 from rawhide.
- ↑ no dnf5 list
- ↑ Both work almost the same way but when we run dnf history info, dnf by default return the last transaction, no need to use the transaction number. DNF5 don't do this, it return nothing, one must use the transaction number always.
- ↑ yeah, no config-manager plugin for dnf5 yet.
- ↑ With version 5.0.7-1 from rawhide "search" command worked just fine
- ↑ dnf5 don't have search yet, using dnf5 repoquery <package> solve this
|
jdg216
|
|
pass
|
warn [1]
|
warn [2]
|
|
|
|
|
- ↑ dnf test ok, but dnf5 doesn't exist
- ↑ dnf history works, but dnf5 needs: dnf history list
|
lruzicka
|
F38, fully updated, Libvirt VM
|
pass [1]
|
pass [2]
|
pass [3]
|
fail [4]
|
pass [5]
|
fail [6]
|
pass
|
- ↑ I am using the unstable version from the COPR
- ↑ unstable COPR version
- ↑
dnf history shows help and requires additional arguments to be used
- ↑ The
config-manager subcommand does not exist for me.
- ↑ Using the unstable COPR version.
- ↑ Subcommand does not exist.
|
markr217
|
kvm, 16G, 4 proc, F38
|
pass
|
pass
|
pass
|
fail [1]
|
pass
|
pass
|
pass
|
- ↑ 4. dnf config-manager --disable <repository-name> (and --enable ) works fine.
dnf enable/disable failed with:
No such command: enable/disable. Please use /usr/bin/dnf --help
It could be a DNF plugin command, try: "dnf install 'dnf-command(enable/disable)'"
- Note: setup for this test specifies bare metal, I was using a kvm.
|
mikelo2
|
podman + Raspberry Pi 3 Model B+
|
pass
|
pass
|
|
|
|
|
|
|
mzink
|
F38 VM
|
pass
|
pass
|
pass
|
warn [1]
|
pass
|
fail [2]
|
pass
|
- ↑ dnf5 doesn't have the ability to enable/disable repo yet.
dnf & dnf5 repolist is in sync when you enable/disable repo and compare the list.
- ↑ sudo dnf5 check-update
Unknown argument "check-update" for command "dnf5"
I assume this is expected. Dnf5 is still under development and does not have all dnf subcommands/parameters.
|
royboy626
|
Fedora 38 Beta Workstation;Bare Metal; x86_64;ZBOXHD-ND22
|
warn [1]
|
pass [2]
|
warn [3]
|
warn [4]
|
warn [5]
|
warn [6]
|
warn [7]
|
- ↑ Assume command should be: 'dnf5 repoquery --info <package-name>'
Assuming that: [PASS]
- ↑ 'dnf list' [PASS]; 'dnf5 list does not exist
- ↑ 'dnf history' [PASS]; dnf5 history not available
- ↑ dnf config-manager <repository-name. [PASS]; dnf5 config-manager unavailable
- ↑ 'dnf search <package-name. [PASS]; 'dnf5 search' unavailable
- ↑ 'dnf check-update' [PASS]; dnf5 check-update unavailable
- ↑ tests names (Ex. dnf5 history) in 'Parity Tests' section should match the commands within the tests (dnf history)
|
Exploratory Testing[edit]
User
|
Profile
|
Exploratory Testing
|
References
|
bittin
|
F38 Beta - Virtualbox
|
pass
|
|
bittin
|
F38 Pre Beta & Beta - Virtualbox
|
pass [1]
|
- ↑ Upgraded the system with sudo dnf5 distro-sync
worked good even with 300+ packages :)
|
msmafra
|
Fedora 38 updated 2023-02-14
|
fail [1]
|
- ↑ dnf5 did not remove unused dependencies:
❯ doas dnf5 remove evince
Removes evince and says Removing unused dependencies: evince-previewer, evince-thumbnailer
❯ doas dnf5 install evince evince-thumbnailer evince-previewer
Package "evince-thumbnailer-44~rc-1.fc38.x86_64" is already installed.
Package "evince-previewer-44~rc-1.fc38.x86_64" is already installed.
|
msmafra
|
https://discussion.fedoraproject.org/u/msmafra/summary
|
warn [1]
|
- ↑ dnf5 doesn't have some commands like search, and makecache and subcommands installed and userinstalled for the history command, for example. It only has:
install, upgrade, remove, distro-sync, downgrade, reinstall, swap, mark, repoquery, group, environment, module, history, repo, advisory, groupinfo, grouplist, repoinfo, repolist, updateinfo, upgrade-minimal, clean, download, makecache, builddep, changelog
|
mzink
|
F38 VM
|
warn [1]
|
- ↑ dnf5 does not have all dnf subcommands.
For example:
dnf update - works
dnf5 update - unknown command
|
urtabajev
|
i3-3220T | 8GB
|
fail [1]
|
- ↑ sudo dnf5 upgrade --enablerepo=updates-testing reports - "Nothing to do."
sudo dnf update --enablerepo=updates-testing --refresh - "Upgrade 24 Packages"
|