From Fedora Project Wiki
mNo edit summary
 
(40 intermediate revisions by the same user not shown)
Line 1: Line 1:
= '''Test Matrix''' =
= '''IoT Release Validation''' =
== '''Installation''' ==
== '''Compose: Fedora-IoT-32-20200312.0''' ==
<div style="background-color: yellow; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: yellow; text-align: center; border-style: solid; border-width: thin">
==== PXE boot ====
==== PXE boot ====
Line 10: Line 10:
| Beta
| Beta
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 26: Line 26:
| Basic
| Basic
| [[QA:Testcase_install_to_SATA]]
| [[QA:Testcase_install_to_SATA]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_install_to_VirtIO]]
| [[QA:Testcase_install_to_VirtIO]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 38: Line 38:


<div style="background-color: darkgoldenrod; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: darkgoldenrod; text-align: center; border-style: solid; border-width: thin">
==== Virtualization ====
==== Virtualization ====
</div>
</div>
Line 46: Line 47:
| Basic
| Basic
| [[QA:Testcase_Install_to_Previous_KVM]]
| [[QA:Testcase_Install_to_Previous_KVM]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_Install_to_Current_KVM]]
| [[QA:Testcase_Install_to_Current_KVM]]
|  {{result|none}}
|  {{result|none}}
|  {{result|none}}
|  {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 59: Line 60:
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">


==== Base ====
==== Disk Image Deployment ====
</div>
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! x86_64 !! AArch64
! Milestone !! Test Case  !! Raspberry Pi 3 !! Pine64 !! Rock960 Consumer Edition !! x86_64 System
|-
| Basic
| [[Ignition]]
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[rpm-ostree upgrade]]
| [[QA:Testcase_arm_image_deployment | Disk Image Deployment]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
| Basic
| [[User:Miabbott/QA/AtomicTests/RpmOstree_Package_Layering | Layered Package Installation]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[User:Pwhalen/QA/IoT_Tests/Rebase | rpm-ostree rebase]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[User:Pwhalen/QA/IoT_Tests/Podman_Basic | Podman ]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 103: Line 76:


<div style="background-color: green; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: green; text-align: center; border-style: solid; border-width: thin">
==== Disk Images ====
 
==== Base ====
</div>
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
{| class="wikitable sortable mw-collapsible" border="1" width=100%
Line 115: Line 89:
| Basic
| Basic
| [[rpm-ostree upgrade]]
| [[rpm-ostree upgrade]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[User:Miabbott/QA/AtomicTests/RpmOstree_Package_Layering | Layered Package Installation]]
| [[User:Miabbott/QA/AtomicTests/RpmOstree_Package_Layering | Layered Package Installation]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[User:Pwhalen/QA/IoT_Tests/Rebase | rpm-ostree rebase]]
| [[User:Pwhalen/QA/IoT_Tests/Rebase | rpm-ostree rebase]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[User:Pwhalen/QA/IoT_Tests/Podman_Basic | Podman ]]
| [[User:Pwhalen/QA/IoT_Tests/Podman_Basic | Podman ]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|warn|pwhalen|1793927}}
|-
|-
| Basic
| Basic
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 147: Line 121:


<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
==== Raspberry Pi Hardware ====
 
==== SBC Hardware Tests ====
</div>
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! Raspberry Pi 3 !! Raspberry Pi 4
! Milestone !! Test Case  !! Raspberry Pi 3 !! Pine64 !! Rock960 Consumer Edition !! Compulab Fitlet2
|-
|-
| Basic
| Basic
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3| Bluetooth]]
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Serial_Console | Serial Console]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Display | Display ]]
| {{result|pass|pwhalen}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Test_Bluetooth | Bluetooth]]
| {{result|fail|pwhalen}}
| style="background:lightgrey;"|
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3| Wi-Fi]]
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Test_WiFi | Wi-Fi]]
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
<div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">


Line 172: Line 163:
! Milestone !! Test Case  !! x86_64 !! AArch64
! Milestone !! Test Case  !! x86_64 !! AArch64
|-
|-
| Basic
| Final
| [[Greenboot]]
| [[Greenboot]]
| {{result|none}}
| {{result|none}}
Line 178: Line 169:
|-
|-
|-
|-
| Basic
| Final
| [[Clevis]]
| [[Clevis]]
| {{result|none}}
| {{result|none}}
Line 184: Line 175:
|-
|-
|}
|}
[[Category:IoT_Testing]]

Latest revision as of 18:20, 13 March 2020

IoT Release Validation

Compose: Fedora-IoT-32-20200312.0

PXE boot

Milestone Test Case x86_64 AArch64
Beta QA:Testcase_Boot_Methods_Pxeboot
Pass pass pwhalen
Pass pass pwhalen


Storage devices

Milestone Test Case x86_64 AArch64
Basic QA:Testcase_install_to_SATA
Pass pass pwhalen
Pass pass pwhalen
Beta QA:Testcase_install_to_VirtIO
Pass pass pwhalen
Pass pass pwhalen


Virtualization

Milestone Test Case x86_64 AArch64
Basic QA:Testcase_Install_to_Previous_KVM
Pass pass pwhalen
Pass pass pwhalen
Beta QA:Testcase_Install_to_Current_KVM
none
Pass pass pwhalen


Disk Image Deployment

Milestone Test Case Raspberry Pi 3 Pine64 Rock960 Consumer Edition x86_64 System
Basic Disk Image Deployment
Pass pass pwhalen
Pass pass pwhalen
none
none


Base

Milestone Test Case x86_64 AArch64
Basic Ignition
none
none
Basic rpm-ostree upgrade
Pass pass pwhalen
Pass pass pwhalen
Basic Layered Package Installation
Pass pass pwhalen
Pass pass pwhalen
Basic rpm-ostree rebase
Pass pass pwhalen
Pass pass pwhalen
Basic Podman
Pass pass pwhalen
Warning warn pwhalen [1]
Basic QA:Testcase_base_selinux
Pass pass pwhalen
Pass pass pwhalen
Basic QA:Testcase_base_service_manipulation
Pass pass pwhalen
Pass pass pwhalen
  1. ↑ RHBZ #1793927

SBC Hardware Tests

Milestone Test Case Raspberry Pi 3 Pine64 Rock960 Consumer Edition Compulab Fitlet2
Basic Serial Console
none
Pass pass pwhalen
none
none
Basic Display
Pass pass pwhalen
Pass pass pwhalen
none
Pass pass pwhalen
Basic Bluetooth
Fail fail pwhalen
none
Pass pass pwhalen
Basic Wi-Fi
Pass pass pwhalen
none
none
Pass pass pwhalen

Final

Milestone Test Case x86_64 AArch64
Final Greenboot
none
none
Final Clevis
none
none
Retrieved from "https://fedoraproject.org/w/index.php?title=User:Pwhalen/QA/IoT/Fedora-IoT-32-20200312.0&oldid=568608"