From Fedora Project Wiki

No edit summary
(import results from testdays app)
Line 119: Line 119:
| {{result|fail||1203632}}
| {{result|fail||1203632}}
| {{result|pass||}}
| {{result|pass||}}
| <references/>
|-
| [[User:todoleza|todoleza]]
| kvm
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:roshi|roshi]]
| Asus Eeepc Netbook (32-bit)
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:mbanas|mbanas]]
| Virtual machine
| {{result|pass}}  <ref>Bug 1198082 encountered while creating user account</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:psklenar|psklenar]]
| dell precision 490
| {{result|pass}}  <ref>{{bz|1205119}}</ref>
| {{result|pass}}  <ref>{{bz|1205094}}</ref><ref>{{bz|1205090}}</ref>{{result|pass}}  <ref>{{bz|1205119}}</ref>
| <references/>
|-
| [[User:jscotka|jscotka]]
| libvirt
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:mhruscak|mhruscak]]
| QEMU Standard PC (i440FX + PIIX, 1
| {{result|fail}}  <ref>{{bz|1205123}}</ref><ref>{{bz|1205106}}</ref><ref>only password problems</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:blaskovic|blaskovic]]
| KVM
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:rhack|rhack]]
| Lenovo T520
| {{result|pass}}  <ref>Webui looks sane against stupid XSS.</ref>
|
| <references/>
|-
| [[User:mkovarik|mkovarik]]
| Lenovo T440s
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:pschindl|pschindl]]
| Lenovo ThinkPad T520
| {{result|pass}}  <ref>Works fine, the workflow is clear for this.</ref>
| {{result|pass}}  <ref>I would be nice if copy and past work. https://github.com/cockpit-project/cockpit/issues/2009</ref>
| <references/>
|-
| [[User:Kinokoio|Kinokoio]]
| libvirt
| {{result|pass}}  <ref>Does not do any password validation (can even be the username)</ref>
| {{result|pass}} 
| <references/>
| <references/>
|-
|-
Line 138: Line 204:
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:roshi|roshi]]
| Asus Eeepc Netbook (32-bit)
| {{result|pass}} 
| {{result|fail}}  <ref>{{bz|1205067}}</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:mbanas|mbanas]]
| Virtual machine
| {{result|pass}} 
| {{result|fail}}  <ref>{{bz|1205067}}</ref><ref>Failed to make filesystem on raid device</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:psklenar|psklenar]]
| dell precision 490
| {{result|pass}} 
|
|
| <references/>
|-
| [[User:jscotka|jscotka]]
| libvirt
| {{result|pass}} 
| {{result|fail}} 
| {{result|pass}} 
| <references/>
|-
| [[User:mhruscak|mhruscak]]
| QEMU Standard PC (i440FX + PIIX, 1
| {{result|pass}} 
| {{result|fail}}  <ref>{{bz|1205067}}</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:blaskovic|blaskovic]]
| KVM
| {{result|pass}} 
| {{result|fail}}  <ref>{{bz|1205067}}</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:mkovarik|mkovarik]]
| Lenovo T440s
| {{result|pass}} 
| {{result|fail}}  <ref>{{bz|1205067}}</ref>
|
| <references/>
|-
| [[User:pschindl|pschindl]]
| Lenovo ThinkPad T520
| {{result|pass}} 
| {{result|pass}}  <ref>Works well with kernel 4.0.0-0.rc4.git1.3. It even cleans /etc/fstab after deleting raid device. Only changing the mount point to empty string isn't working.</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:Kinokoio|Kinokoio]]
| libvirt
| {{result|pass}} 
| {{result|fail}}  {{result|pass}} 
| {{result|pass}} 
| <references/>
| <references/>
|-
|-
Line 157: Line 286:
| {{result|pass}}   
| {{result|pass}}   
| <references/>
| <references/>
|-
| [[User:jscotka|jscotka]]
| libvirt
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:mhruscak|mhruscak]]
| QEMU Standard PC (i440FX + PIIX, 1
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:blaskovic|blaskovic]]
| KVM
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:mkovarik|mkovarik]]
| Lenovo T440s
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:pschindl|pschindl]]
| Lenovo ThinkPad T520
| {{result|pass}} 
|
| <references/>
|-
|}
=== Network ===
{|
! User
! Hardware
! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_NetworkIO Monitor network I/O]
! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_VLAN Create VLAN]
! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_Bond Create Bond]
! References
|-
| [[User:roshi|roshi]]
| Asus Eeepc Netbook (32-bit)
| {{result|pass}} 
|
|
| <references/>
|-
| [[User:mbanas|mbanas]]
| Virtual machine
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:psklenar|psklenar]]
| None
|
|
| {{result|pass}}  <ref>{{bz|1205166}}</ref>
| <references/>
|-
| [[User:jscotka|jscotka]]
| libvirt
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:mhruscak|mhruscak]]
| QEMU Standard PC (i440FX + PIIX, 1
| {{result|pass}} 
| {{result|pass}} 
| {{result|fail}}  <ref>{{bz|1205211}}</ref>
| <references/>
|-
| [[User:blaskovic|blaskovic]]
| KVM
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:mkovarik|mkovarik]]
| Lenovo T440s
| {{result|pass}} 
| {{result|pass}}  {{result|pass}}  {{result|pass}} 
|
| <references/>
|-
| [[User:Kinokoio|Kinokoio]]
| libvirt
| {{result|pass}} 
|
|
| <references/>
|-
|}
|}



Revision as of 23:20, 4 May 2015

Fedora Test Days
Cockpit Test Day

Date 2015-03-24
Time all day

Website QA/Fedora_22_test_days
IRC #fedora-test-day (webirc)
Mailing list cockpit-devel


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today's installment of Fedora Test Day will focus on testing Cockpit. Cockpit is a server admin interface.

http://cockpit-project.org

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day

A machine that can run Fedora 22 and that you can screw around with. This can be a virtual machine, but we are also very interested in test results on real hardware.

The test machine should ideally have multiple disks and multiple network interfaces. If you use a virtual machine, just add some virtual disks and network adapters.

# curl https://fedorapeople.org/groups/qa/test_days/fedora22-cockpit-x86_64.qcow2.xz > fedora22-cockpit-x86_64.qcow2.xz
# unxz fedora22-cockpit-x86_64.qcow2.xz
# yum -y install qemu\*
# systemctl  restart libvirtd
# virt-install --connect qemu:///system --ram 2048 -n cockpit --os-type=linux --os-variant=fedora20 --disk path=fedora22-cockpit-x86_64.qcow2,device=disk,format=qcow2 --vcpus=1 --vnc --noautoconsole --import
# sleep 60
# MAC=`virsh dumpxml cockpit | grep 'mac address' | cut -d\' -f2`
# IP=`cat /var/lib/libvirt/dnsmasq/default.leases |grep $MAC| head -1 | cut -d ' ' -f 3`
# echo "connect to http://$IP:9090 (user/password: root/testvm testwheel/testwheel test/test)"

How to test?

After boot, Cockpit is up and running and listens on port 9090.

Firefox 36.0 is known to choke on the HTTPS certificates created by Cockpit 0.44 and earlier.
See the end of this page for a workaround.
The firewall might or might not be open for Cockpit.
See the end of this page for details.
  • Point a browser at http://<server-ip-address>:9090.
  • Cockpit's login page will load.
  • Cockpit uses a self-signed certificate, and your browser will very likely warn you about it.

(Here, <server-ip-address> is the IP address of your machine. You can find it by logging into the machine on the text console as "root" and running ip addr.)

Once the Cockpit log in screen is loaded in your browser, log in as "root" or some other user in the "wheel" group. You can log into Cockpit as any user that exists on the machine, but only "root" or "wheel" members have enough privileges to execute the test cases.

The test cases are intentionally a bit vague. They don't tell you exactly what button to click, and what to type into which field. You have to figure that out yourself! :-) Cockpit should be `discoverable´, and your feedback about this is very valuable.

The test cases don't cover every feature of Cockpit. Please stray from the test cases into whatever corner of Cockpit you want to explore!

When Cockpit encounters an internal error, a red "Oops" label will appear at the top right. Please report it when this happens. Look in the javascript console (Ctrl-Shift-J) for details. It is not a good idea to continue using Cockpit after an "Oops", but simply reloading the page should put you back on track.

Please report your feedback either on Github or in Bugzilla.

Test Cases

Test Results

If you have problems with any of the tests, report a bug either on Github or in Bugzilla.

For reporting results use primarily fedora testday app

Fedora testday app

If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the tables below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

Basic

User Hardware Password change Create user account References
Stefw Lenovo laptop
Pass pass [1]
[2]
Fail fail [3]
  1. RHBZ #XXXXXXX
  2. Example entry
  3. RHBZ #1000000
Truong Anh Tuan Asus Laptop
Fail fail [1]
Pass pass
  1. RHBZ #1203632
todoleza kvm
Pass pass
Pass pass
roshi Asus Eeepc Netbook (32-bit)
Pass pass
Pass pass
mbanas Virtual machine
Pass pass
[1]
Pass pass
  1. Bug 1198082 encountered while creating user account
psklenar dell precision 490
Pass pass
[1]
Pass pass
[2][3]
Pass pass
[4]
  1. RHBZ #1205119
  2. RHBZ #1205094
  3. RHBZ #1205090
  4. RHBZ #1205119
jscotka libvirt
Pass pass
Pass pass
mhruscak QEMU Standard PC (i440FX + PIIX, 1
Fail fail
[1][2][3]
Pass pass
  1. RHBZ #1205123
  2. RHBZ #1205106
  3. only password problems
blaskovic KVM
Pass pass
Pass pass
rhack Lenovo T520
Pass pass
[1]
  1. Webui looks sane against stupid XSS.
mkovarik Lenovo T440s
Pass pass
Pass pass
pschindl Lenovo ThinkPad T520
Pass pass
[1]
Pass pass
[2]
  1. Works fine, the workflow is clear for this.
  2. I would be nice if copy and past work. https://github.com/cockpit-project/cockpit/issues/2009
Kinokoio libvirt
Pass pass
[1]
Pass pass
  1. Does not do any password validation (can even be the username)

Storage

User Hardware Monitor disk I/O Create a RAID Device Create a Logical Volume References
Stef Walter Lenovo Laptop
Pass pass
[1]
Pass pass
Pass pass
  1. Test entry
roshi Asus Eeepc Netbook (32-bit)
Pass pass
Fail fail
[1]
Pass pass
  1. RHBZ #1205067
mbanas Virtual machine
Pass pass
Fail fail
[1][2]
Pass pass
  1. RHBZ #1205067
  2. Failed to make filesystem on raid device
psklenar dell precision 490
Pass pass
jscotka libvirt
Pass pass
Fail fail
Pass pass
mhruscak QEMU Standard PC (i440FX + PIIX, 1
Pass pass
Fail fail
[1]
Pass pass
  1. RHBZ #1205067
blaskovic KVM
Pass pass
Fail fail
[1]
Pass pass
  1. RHBZ #1205067
mkovarik Lenovo T440s
Pass pass
Fail fail
[1]
  1. RHBZ #1205067
pschindl Lenovo ThinkPad T520
Pass pass
Pass pass
[1]
Pass pass
  1. Works well with kernel 4.0.0-0.rc4.git1.3. It even cleans /etc/fstab after deleting raid device. Only changing the mount point to empty string isn't working.
Kinokoio libvirt
Pass pass
Fail fail
Pass pass
Pass pass


Docker

User Hardware Download and run image Create a new image and run it References
Stef Walter Lenovo Laptop
Pass pass
Pass pass
jscotka libvirt
Pass pass
Pass pass
mhruscak QEMU Standard PC (i440FX + PIIX, 1
Pass pass
Pass pass
blaskovic KVM
Pass pass
Pass pass
mkovarik Lenovo T440s
Pass pass
Pass pass
pschindl Lenovo ThinkPad T520
Pass pass

Network

User Hardware Monitor network I/O Create VLAN Create Bond References
roshi Asus Eeepc Netbook (32-bit)
Pass pass
mbanas Virtual machine
Pass pass
Pass pass
Pass pass
psklenar None
Pass pass
[1]
  1. RHBZ #1205166
jscotka libvirt
Pass pass
Pass pass
Pass pass
mhruscak QEMU Standard PC (i440FX + PIIX, 1
Pass pass
Pass pass
Fail fail
[1]
  1. RHBZ #1205211
blaskovic KVM
Pass pass
Pass pass
Pass pass
mkovarik Lenovo T440s
Pass pass
Pass pass
Pass pass
Pass pass
Kinokoio libvirt
Pass pass

Notes

We recommend that you install Fedora 22 Server since we would like you to also test whether Cockpit really works out of the box. Of course, if you would like to test Cockpit but would rather not go through the trouble of installing Fedora from scratch yet one more time, you can also add Cockpit to your existing Fedora system.

# dnf install cockpit
# firewall-cmd --permanent --add-service cockpit
# firewall-cmd --add-service cockpit
# systemctl start cockpit.socket
# systemctl enable cockpit.socket

Work around for Firefox certificate problem

If you are using Firefox 36.0 (and maybe also older versions), you might experience long delays and even crashes when connecting to Cockpit. See this bug report. You can work around this by executing the following commands in the machine that runs Cockpit before connecting to Cockpit for the first time.

# cd /tmp
# openssl req -x509 -days 36500 -newkey rsa:2048 -keyout KEY -keyform PEM -nodes -out CERT -outform PEM -subj /CN=localhost
# cat CERT KEY >/etc/cockpit/ws-certs.d/~self-signed.cert
# rm CERT KEY
# systemctl restart cockpit

Opending the firewall for Cockpit

Depending on how you have installed Cockpit, the firewall might or might not be open for it. If you install Fedora Server, it should be open, but it currently is not. See this bug.

In any case, execute the following commands to open it.

# firewall-cmd --add-service cockpit
# firewall-cmd --permanent --add-service cockpit

The effect is immediate, you don't need to restart Cockpit.

Long comments