From Fedora Project Wiki

No edit summary
 
Line 55: Line 55:
== Test Results ==
== Test Results ==


Test results will be transferred after the test day is over
=== Podman 5 ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_podman_save_load Save and Load Images]
! References
|-
| [[User:AngusVW|AngusVW]]
| Operating System: Fedora Linux 40 (Workstation Edition Prerelease) Architecture: x86-64 Hardware Vendor: Dell Inc. Hardware Model: Latitude 7490
| {{result|pass}}<ref>The image was pulled and saved with podman 4.9.3 on Fedora Silverblue 39 by IMAGE ID.
The image was transferred to and loaded on Fedora 40 by IMAGE ID.
The image was verified to exist but did not retain the repository name.
When a container was created with the image, there was a prompt to select repository,
and the container was created successfully.</ref>{{result|pass}}<ref>The image was pulled and saved on Fedora Silverblue 39 by IMAGE ID.
The image was transferred to and loaded on Fedora 40 by IMAGE ID.
The image was verified to exist but did not retain the repository name.
When a container was created with the image, there was a prompt to select repository,
and the container was created successfully.</ref>
| <references/>
|-
| [[User:alciregi|alciregi]]
| Fedora 40 x86_64
| {{result|pass}}
| <references/>
|-
| [[User:danniel|danniel]]
| Fedora 40 x86_64
| {{result|pass}}
| <references/>
|-
| [[User:davidel|davidel]]
| Fedora 40 x86_64
| {{result|pass}}
| <references/>
|-
| [[User:dtma|dtma]]
| KVM,F40,x86_64
| {{result|pass}}
| <references/>
|-
| [[User:ersen|ersen]]
| Fedora 40 x86_64
| {{result|pass}}
| <references/>
|-
| [[User:geraldosimiao|geraldosimiao]]
| F40 KDE at Acer Aspire V3-571 / i7-3632QM
| {{result|pass}}
| <references/>
|-
| [[User:hricky|hricky]]
| Raspberry Pi 4, IoT 39.20231103.1, podman version 4.7.0 -> IoT 40.20240321.0, podman 5.0.0-rc2
| {{result|pass}}
| <references/>
|-
| [[User:kronenpj|kronenpj]]
| KVM Virtual Machine; Fedora 40
| {{result|pass}}
| <references/>
|-
| [[User:nimdanitro|nimdanitro]]
| Fedora 40 x86_64
| {{result|pass}}
| <references/>
|-
| [[User:noadcoco|noadcoco]]
| Fedora Linux 40 WorkStation + 4Gb RAM + CPU: AMD E2-9000e RADEON + GPU: AMD ATI RADEON
| {{result|pass}}
| <references/>
|-
| [[User:orimanabu|orimanabu]]
| Fedora 40 aarch64
| {{result|pass}}<ref>Fedora Linux Asahi Remix on MacBook Air M2</ref>
| <references/>
|-
| [[User:plugs|plugs]]
| Fedora 40 on aarch64
| {{result|pass}}
| <references/>
|-
| [[User:pnemade|pnemade]]
| F40 Silverblue x86_64
| {{result|pass}}
| <references/>
|-
| [[User:r0b0ty|r0b0ty]]
| KVM Virtual Machine; Fedora 40 x86_64
| {{result|pass}}<ref>Using Fedora-KDE-Live-x86_64-40_Beta-1.10.iso in Virtual Manager.  Original image saved using Podman 4.9.3 and loaded in the VM using Podman 5.0.0.  All expected results were observed.</ref>
| <references/>
 
|-
|}
 
=== Basic Test ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_podman_images Image Pull]
! [http://fedoraproject.org/wiki/QA:Testcase_podman_container Container]
! [http://fedoraproject.org/wiki/QA:Testcase_podman_list_container List Container]
! [http://fedoraproject.org/wiki/QA:Testcase_podman_remove_container Remove Container]
! [http://fedoraproject.org/wiki/QA:Testcase_podman_inspect_container Inspect]
! References
|-
| [[User:AngusVW|AngusVW]]
| Operating System: Fedora Linux 40 (Workstation Edition Prerelease) Architecture: x86-64 Hardware Vendor: Dell Inc. Hardware Model: Latitude 7490
| {{result|pass}}<ref>The fedora:latest image was pulled successfully</ref>
| {{result|pass}}<ref>The container was started, accessed, exited, and was removed successfully.</ref>
| {{result|pass}}<ref>podman ps did not list the container
podman ps --all listed the container with Status: Exited</ref>
| {{result|pass}}<ref>The container was listed with podman ps --all and removed succcessfully</ref>
| {{result|pass}}<ref>The container was identified and inspected by CONTAINER ID successfully.</ref>
| <references/>
|-
| [[User:alciregi|alciregi]]
| Fedora 40 x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
|
| <references/>
|-
| [[User:alciregi|alciregi]]
| Oracle Cloud VM.Standard.A1.Flex
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
|
| <references/>
|-
| [[User:danniel|danniel]]
| Fedora 40 x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:davidel|davidel]]
| Fedora 40 x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>I ran a container with the following command podman run -dt -p 8080:80/tcp docker.io/library/httpd on podman 4.9 on Fedora 39 and on podman 5 on Fedora 40 and the I compared podman inspect output
1. EntryPoint value is "" on 4.9 and it is null on 5
2. StopSignal is 28 on 4.9 and it is "SIGWINCH" on 5
3. NetworkMode is "slirp4netns" on 4.9 and "pasta" on 5
4. "PortBindings"."80/tcp"[0]."HostIp" is "" on 4.9 and "0.0.0.0" on 5
5. Ulimits are different
6. "Ports"."80/tcp"[0]."HostIp" is "" on 4.9 and "0.0.0.0" on 5
7. State has a nested Health object on 4.9 but not on 5</ref>
| <references/>
|-
| [[User:dtma|dtma]]
| KVM,F40,x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:ersen|ersen]]
| Fedora 40 x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
|
| <references/>
|-
| [[User:garrmcnu|garrmcnu]]
| Fedora Workstation 40 (Beta 1.10) on KVM
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:hricky|hricky]]
| Raspberry Pi 4, IoT 40.20240321.0, podman 5.0.0-rc2
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:kronenpj|kronenpj]]
| KVM Virtual Machine; Fedora 40
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:nimdanitro|nimdanitro]]
| Fedora 40 x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|warn}}<ref>Compared various images between podman 4.9 and podman5. Only noticable difference is that with Podman 5 the StopSignal is a string (e.g. "SIGTERM") and not numerical as before:</ref>
| <references/>
|-
| [[User:noadcoco|noadcoco]]
| Fedora Linux 40 WorkStation + 4Gb RAM + CPU: AMD E2-9000e RADEON + GPU: AMD ATI RADEON
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:orimanabu|orimanabu]]
| Fedora 40 aarch64
| {{result|pass}}<ref>Fedora Linux Asahi Remix on MacBook Air M2</ref>
| {{result|pass}}<ref>Fedora Linux Asahi Remix on MacBook Air M2</ref>
| {{result|pass}}<ref>Fedora Linux Asahi Remix on MacBook Air M2</ref>
| {{result|pass}}<ref>Fedora Linux Asahi Remix on MacBook Air M2</ref>
| {{result|pass}}<ref>Fedora Linux Asahi Remix on MacBook Air M2</ref>
| <references/>
|-
| [[User:orimanabu|orimanabu]]
| Fedora 40 aarch64 (Asahi Remix on MBA M2)
| {{result|pass}}
|
|
|
|
| <references/>
|-
| [[User:plugs|plugs]]
| Fedora 40 on aarch64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}{{result|fail}}
| {{result|pass}}
| <references/>
|-
| [[User:pnemade|pnemade]]
| F40 Silverblue x86_64
| {{result|pass}}
|
|
|
|
| <references/>
|-
| [[User:r0b0ty|r0b0ty]]
| KVM Virtual Machine; Fedora 40 x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:vishalvvr|vishalvvr]]
|  KVM,F40,x86_64
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
| {{result|pass}}
| <references/>
 
|-
|}
 
 


[[Category:Fedora 40 Test Days]]
[[Category:Fedora 40 Test Days]]

Latest revision as of 02:27, 24 April 2024

Podman 5

Date 2024-03-21 to 2024-03-26
Time all day

Website QA/Test Days
Matrix #test-day:fedoraproject.org
Mailing list test


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

This Fedora Test Week will focus on testing

  1. Upgrade from 4.9 and lower to 5.0
  2. Test ‘Podman save’ from 4.9 and ‘Podman load’ in 5.0
  3. FCOS/Silverblue
  4. Toolbx
  5. Add Karmas to https://bodhi.fedoraproject.org/updates/FEDORA-2024-a267e93f8c

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion. Use #podman or #fedora-test-day channels on libera chat. Alternatively, write on podman room In case of problem related to test day organization/wiki/whatever, please reach out to sumantrom.

Prerequisite for Test Day[edit]

  • A system (real or virtual) you can install Fedora 40, and not mind if it breaks
  • A simple way to get podman 5.0.0-1 would be "sudo dnf install podman --enablerepo=updates-testing".
  • Ensure running " rpm -qa podman" gives "podman-5.0.0-1.fc40.x86_64"

How to test?[edit]

Install Fedora[edit]

Testing Podman from a live environment is difficult and will likely wind up with the system exhausting available RAM and failing in strange ways, so we recommend you install Fedora 40 for this Test Week, or run a Fedora 39 and/or Fedora 40 container using Podman 5.

Update your machine[edit]

Run the tests[edit]

Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.

Reporting bugs[edit]

If you have problems with any of the tests, report a bug to Bugzilla usually for the component podman. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

Known issues[edit]

Test Results[edit]

Podman 5[edit]

User Profile Save and Load Images References
AngusVW Operating System: Fedora Linux 40 (Workstation Edition Prerelease) Architecture: x86-64 Hardware Vendor: Dell Inc. Hardware Model: Latitude 7490
Pass pass
[1]
Pass pass
[2]
  1. The image was pulled and saved with podman 4.9.3 on Fedora Silverblue 39 by IMAGE ID. The image was transferred to and loaded on Fedora 40 by IMAGE ID. The image was verified to exist but did not retain the repository name. When a container was created with the image, there was a prompt to select repository, and the container was created successfully.
  2. The image was pulled and saved on Fedora Silverblue 39 by IMAGE ID. The image was transferred to and loaded on Fedora 40 by IMAGE ID. The image was verified to exist but did not retain the repository name. When a container was created with the image, there was a prompt to select repository, and the container was created successfully.
alciregi Fedora 40 x86_64
Pass pass
danniel Fedora 40 x86_64
Pass pass
davidel Fedora 40 x86_64
Pass pass
dtma KVM,F40,x86_64
Pass pass
ersen Fedora 40 x86_64
Pass pass
geraldosimiao F40 KDE at Acer Aspire V3-571 / i7-3632QM
Pass pass
hricky Raspberry Pi 4, IoT 39.20231103.1, podman version 4.7.0 -> IoT 40.20240321.0, podman 5.0.0-rc2
Pass pass
kronenpj KVM Virtual Machine; Fedora 40
Pass pass
nimdanitro Fedora 40 x86_64
Pass pass
noadcoco Fedora Linux 40 WorkStation + 4Gb RAM + CPU: AMD E2-9000e RADEON + GPU: AMD ATI RADEON
Pass pass
orimanabu Fedora 40 aarch64
Pass pass
[1]
  1. Fedora Linux Asahi Remix on MacBook Air M2
plugs Fedora 40 on aarch64
Pass pass
pnemade F40 Silverblue x86_64
Pass pass
r0b0ty KVM Virtual Machine; Fedora 40 x86_64
Pass pass
[1]
  1. Using Fedora-KDE-Live-x86_64-40_Beta-1.10.iso in Virtual Manager. Original image saved using Podman 4.9.3 and loaded in the VM using Podman 5.0.0. All expected results were observed.

Basic Test[edit]

User Profile Image Pull Container List Container Remove Container Inspect References
AngusVW Operating System: Fedora Linux 40 (Workstation Edition Prerelease) Architecture: x86-64 Hardware Vendor: Dell Inc. Hardware Model: Latitude 7490
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. The fedora:latest image was pulled successfully
  2. The container was started, accessed, exited, and was removed successfully.
  3. podman ps did not list the container podman ps --all listed the container with Status: Exited
  4. The container was listed with podman ps --all and removed succcessfully
  5. The container was identified and inspected by CONTAINER ID successfully.
alciregi Fedora 40 x86_64
Pass pass
Pass pass
Pass pass
alciregi Oracle Cloud VM.Standard.A1.Flex
Pass pass
Pass pass
Pass pass
danniel Fedora 40 x86_64
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
davidel Fedora 40 x86_64
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
[1]
  1. I ran a container with the following command podman run -dt -p 8080:80/tcp docker.io/library/httpd on podman 4.9 on Fedora 39 and on podman 5 on Fedora 40 and the I compared podman inspect output 1. EntryPoint value is "" on 4.9 and it is null on 5 2. StopSignal is 28 on 4.9 and it is "SIGWINCH" on 5 3. NetworkMode is "slirp4netns" on 4.9 and "pasta" on 5 4. "PortBindings"."80/tcp"[0]."HostIp" is "" on 4.9 and "0.0.0.0" on 5 5. Ulimits are different 6. "Ports"."80/tcp"[0]."HostIp" is "" on 4.9 and "0.0.0.0" on 5 7. State has a nested Health object on 4.9 but not on 5
dtma KVM,F40,x86_64
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
ersen Fedora 40 x86_64
Pass pass
Pass pass
Pass pass
garrmcnu Fedora Workstation 40 (Beta 1.10) on KVM
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
hricky Raspberry Pi 4, IoT 40.20240321.0, podman 5.0.0-rc2
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
kronenpj KVM Virtual Machine; Fedora 40
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
nimdanitro Fedora 40 x86_64
Pass pass
Pass pass
Pass pass
Pass pass
Warning warn
[1]
  1. Compared various images between podman 4.9 and podman5. Only noticable difference is that with Podman 5 the StopSignal is a string (e.g. "SIGTERM") and not numerical as before:
noadcoco Fedora Linux 40 WorkStation + 4Gb RAM + CPU: AMD E2-9000e RADEON + GPU: AMD ATI RADEON
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
orimanabu Fedora 40 aarch64
Pass pass
[1]
Pass pass
[2]
Pass pass
[3]
Pass pass
[4]
Pass pass
[5]
  1. Fedora Linux Asahi Remix on MacBook Air M2
  2. Fedora Linux Asahi Remix on MacBook Air M2
  3. Fedora Linux Asahi Remix on MacBook Air M2
  4. Fedora Linux Asahi Remix on MacBook Air M2
  5. Fedora Linux Asahi Remix on MacBook Air M2
orimanabu Fedora 40 aarch64 (Asahi Remix on MBA M2)
Pass pass
plugs Fedora 40 on aarch64
Pass pass
Pass pass
Pass pass
Pass pass
Fail fail
Pass pass
pnemade F40 Silverblue x86_64
Pass pass
r0b0ty KVM Virtual Machine; Fedora 40 x86_64
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
vishalvvr KVM,F40,x86_64
Pass pass
Pass pass
Pass pass
Pass pass