From Fedora Project Wiki
(Created page with "= '''Test Matrix''' = == '''Installation''' == <div style="background-color: yellow; text-align: center; border-style: solid; border-width: thin"> ==== PXE boot ==== </div> {|...")
 
 
(43 intermediate revisions by the same user not shown)
Line 1: Line 1:
= '''Test Matrix''' =
= '''IoT Release Validation''' =
== '''Installation''' ==
== '''Compose: Fedora-IoT-32-20200312.0''' ==
<div style="background-color: yellow; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: yellow; text-align: center; border-style: solid; border-width: thin">
==== PXE boot ====
==== PXE boot ====
Line 10: Line 10:
| Beta
| Beta
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 26: Line 26:
| Basic
| Basic
| [[QA:Testcase_install_to_SATA]]
| [[QA:Testcase_install_to_SATA]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_install_to_VirtIO]]
| [[QA:Testcase_install_to_VirtIO]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 38: Line 38:


<div style="background-color: darkgoldenrod; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: darkgoldenrod; text-align: center; border-style: solid; border-width: thin">
==== Virtualization ====
==== Virtualization ====
</div>
</div>
Line 46: Line 47:
| Basic
| Basic
| [[QA:Testcase_Install_to_Previous_KVM]]
| [[QA:Testcase_Install_to_Previous_KVM]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_Install_to_Current_KVM]]
| [[QA:Testcase_Install_to_Current_KVM]]
|  {{result|none}}
|  {{result|none}}
|  {{result|none}}
|  {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 58: Line 59:


<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
==== Disk Image Deployment ====
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! Raspberry Pi 3 !! Pine64 !! Rock960 Consumer Edition !! x86_64 System
|-
| Basic
| [[QA:Testcase_arm_image_deployment | Disk Image Deployment]]
| {{result|pass|pwhalen}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: green; text-align: center; border-style: solid; border-width: thin">


==== Base ====
==== Base ====
Line 71: Line 89:
| Basic
| Basic
| [[rpm-ostree upgrade]]
| [[rpm-ostree upgrade]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[Layered Package Installation]]
| [[User:Miabbott/QA/AtomicTests/RpmOstree_Package_Layering | Layered Package Installation]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[rpm-ostree rebase]]
| [[User:Pwhalen/QA/IoT_Tests/Rebase | rpm-ostree rebase]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[Container Runtime]]
| [[User:Pwhalen/QA/IoT_Tests/Podman_Basic | Podman ]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|warn|pwhalen|1793927}}
|-
|-
| Basic
| Basic
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
<references/>
<references/>


<div style="background-color: green; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
==== Disk Images ====
 
==== SBC Hardware Tests ====
</div>
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! x86_64 !! AArch64
! Milestone !! Test Case  !! Raspberry Pi 3 !! Pine64 !! Rock960 Consumer Edition !! Compulab Fitlet2
|-
| Basic
| [[Ignition]]
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[rpm-ostree upgrade]]
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[Layered Package Installation]]
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Serial_Console | Serial Console]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| {{result|pass|pwhalen}}
| Basic
| [[rpm-ostree rebase]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[Container Runtime]]
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Display | Display ]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[QA:Testcase_base_selinux]]
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Test_Bluetooth | Bluetooth]]
| {{result|none}}
| {{result|fail|pwhalen}}
| style="background:lightgrey;"|
| {{result|none}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Basic
| Basic
| [[QA:Testcase_base_service_manipulation]]
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Test_WiFi | Wi-Fi]]
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
<references/>
<div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">


<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
==== Final ====
==== Raspberry Pi Hardware ====
</div>
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! Raspberry Pi 3 !! Raspberry Pi 4
! Milestone !! Test Case  !! x86_64 !! AArch64
|-
|-
| Basic
| Final
| [[Bluetooth]]
| [[Greenboot]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
|-
|-
| Basic
| Final
| [[Wi-Fi]]
| [[Clevis]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
|}
|}
[[Category:IoT_Testing]]

Latest revision as of 18:20, 13 March 2020

IoT Release Validation

Compose: Fedora-IoT-32-20200312.0

PXE boot

Milestone Test Case x86_64 AArch64
Beta QA:Testcase_Boot_Methods_Pxeboot
Pass pass pwhalen
Pass pass pwhalen


Storage devices

Milestone Test Case x86_64 AArch64
Basic QA:Testcase_install_to_SATA
Pass pass pwhalen
Pass pass pwhalen
Beta QA:Testcase_install_to_VirtIO
Pass pass pwhalen
Pass pass pwhalen


Virtualization

Milestone Test Case x86_64 AArch64
Basic QA:Testcase_Install_to_Previous_KVM
Pass pass pwhalen
Pass pass pwhalen
Beta QA:Testcase_Install_to_Current_KVM
none
Pass pass pwhalen


Disk Image Deployment

Milestone Test Case Raspberry Pi 3 Pine64 Rock960 Consumer Edition x86_64 System
Basic Disk Image Deployment
Pass pass pwhalen
Pass pass pwhalen
none
none


Base

Milestone Test Case x86_64 AArch64
Basic Ignition
none
none
Basic rpm-ostree upgrade
Pass pass pwhalen
Pass pass pwhalen
Basic Layered Package Installation
Pass pass pwhalen
Pass pass pwhalen
Basic rpm-ostree rebase
Pass pass pwhalen
Pass pass pwhalen
Basic Podman
Pass pass pwhalen
Warning warn pwhalen [1]
Basic QA:Testcase_base_selinux
Pass pass pwhalen
Pass pass pwhalen
Basic QA:Testcase_base_service_manipulation
Pass pass pwhalen
Pass pass pwhalen
  1. ↑ RHBZ #1793927

SBC Hardware Tests

Milestone Test Case Raspberry Pi 3 Pine64 Rock960 Consumer Edition Compulab Fitlet2
Basic Serial Console
none
Pass pass pwhalen
none
none
Basic Display
Pass pass pwhalen
Pass pass pwhalen
none
Pass pass pwhalen
Basic Bluetooth
Fail fail pwhalen
none
Pass pass pwhalen
Basic Wi-Fi
Pass pass pwhalen
none
none
Pass pass pwhalen

Final

Milestone Test Case x86_64 AArch64
Final Greenboot
none
none
Final Clevis
none
none
Retrieved from "https://fedoraproject.org/w/index.php?title=User:Pwhalen/QA/IoT/Fedora-IoT-32-20200312.0&oldid=568608"