Test Day:2014-09-16 Cockpit: Difference between revisions

Latest revision as of 21:42, 19 September 2016

Fedora Test Days

Cockpit Test Day

Date	2014-09-16
Time	all day

Website	QA/Fedora_21_test_days
IRC	#fedora-test-day (webirc)
Mailing list	cockpit-devel

Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today's installment of Fedora Test Day will focus on testing Cockpit. Cockpit is a server user interface.

http://cockpit-project.org

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Development - Stef Walter (stefw), Marius Vollmer (mvollmer), Andreas Nilsson (andreasn), Patrick Uiterwijk (puiterwijk)
Quality Assurance - Jan Ščotka (jscotka)

Prerequisite for Test Day[edit]

A machine that can run Fedora 21 and that you can screw around with. This can be a virtual machine, but we are also very interested in test results on real hardware.

The test machine should ideally have multiple disks and multiple network interfaces. If you use a virtual machine, just add some virtual disks and network adapters.

Install Fedora 21 Server. Make sure that your installation is recent enough. Either install Fedora 21 Server Alpha TC7 or run yum update in an older Fedora 21 Server installation. You should have at least Cockpit 0.23. In the Server variant of Fedora 21, Cockpit is enabled by default. For other variants, please refer to the Notes at the end of this page.
Prepared Live ISO images: (root have no password here by default, anything you type will access cockpit page)
- x86_64 - https://fedorapeople.org/groups/qa/20140916-Cockpit-Test-Day-Live-x86_64.iso
- i386 (without Docker) - https://fedorapeople.org/groups/qa/20140916-Cockpit-Test-Day-Live-i386.iso
Image for virt-manager : http://fedorapeople.org/groups/qa/20140916-Cockpit-VM-disk-image.qcow2.xz
- user/password: test/test root/internal

curl https://fedorapeople.org/groups/qa/20140916-Cockpit-VM-disk-image.qcow2.xz >20140916-Cockpit-VM-disk-image.qcow2.xz
unxz 20140916-Cockpit-VM-disk-image.qcow2.xz
yum -y install qemu\*
systemctl  restart libvirtd
virt-install --connect qemu:///system --ram 1024 -n cockpit --os-type=linux --os-variant=fedora20 --disk path=20140916-Cockpit-VM-disk-image.qcow2,device=disk,format=qcow2 --vcpus=1 --vnc --noautoconsole --import
virt-manager&

Note that Docker is not enabled by default, but the test cases will tell you how to enable it.

How to test?[edit]

After boot, Cockpit is up and running and listens on port 9090.

Point a browser at http://<server-ip-address>:9090.
Cockpit's login page will load.
Cockpit uses a self-signed certificate, and your browser will very likely warn you about it.

(Here, <server-ip-address> is the IP address of your machine. You can find it by logging into the machine on the text console as "root" and running ip addr.)

Once the Cockpit log in screen is loaded in your browser, log in as "root". You can log into Cockpit as any user that exists on the machine, but currently only "root" has enough privileges to execute the test cases. Trying with any other user, even those that are in the "wheel" group, will likely lead to techno-babble error messages. (This will be improved as Cockpit and its dependencies evolve, of course.)

The test cases are intentionally a bit vague. They don't tell you exactly what button to click, and what to type into which field. You have to figure that out yourself! :-) Cockpit should be discoverable´, and your feedback about this is very valuable.

Unfortunately, Cockpit is quite far from being finished. There are so many things worth improving that it will be a lot of work to report them all. For example, most of the dialogs don't do intelligent validation of user input. Thus, we can not ask you to be exhaustive. Feel free to report only things that you consider non-obvious´ or are particularily important to you.

The test cases don't cover every feature of Cockpit. Please stray from the test cases into whatever corner of Cockpit you want to explore!

When Cockpit encounters an internal error, a red "Oops" label will appear at the top right. Please report it when this happens. It is not a good idea to continue using Cockpit after an "Oops", but simply reloading the page should put you back on track.

Please report your feedback either on Github or in Bugzilla.

Test Cases[edit]

Basic
- Password change
- Create user account

Storage

Network

Docker
- Download and run image
- Create a new image and run it

Test Results[edit]

If you have problems with any of the tests, report a bug either on Github or in Bugzilla.

If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the tables below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

Basic[edit]

User	Hardware	Password change	Create user account	References
Alich	Hewlett-Packard HP xw4600 Workstation	pass ^[1] ^[2]	fail ^[3]	↑ RHBZ #1142175 ↑ Useless logout message ↑ RHBZ #1142234
jskladan	X230	pass	pass
lnie	virt-manager	pass	pass
baoboa	HP workstation Z400	pass	pass
jprokes	VPS	fail ^[1] ^[2]	pass	↑ RHBZ #1142208 ↑ Problem with password change on multiple servers managed by cockpit.
dspurek	Lenovo 440s (+VM)	fail ^[1] ^[2]	pass	↑ RHBZ #1142154 ↑ unprivileged user can't change own password
roshi	virt-manager	pass	pass
psklenar	virt image	pass ^[1] ^[2] ^[3]	pass	↑ RHBZ #1142210 ↑ RHBZ #1135444 ↑ selinux, random log out
elemc	Gigabyte PH67-DS3-B3	pass	pass
lpol	openstack instances	pass	pass ^[1] ^[2] pass	↑ RHBZ #1142229 ↑ RHBZ #1142215
jscotka	lenovo T61	pass	pass ^[1] ^[2] pass ^[1] ^[3]^[4]	↑ ^1.0 ^1.1 RHBZ #1140562 ↑ second trouble: https://github.com/cockpit-project/cockpit/issues/1160 ↑ RHBZ #[[rhbug:\|]] ↑ second trouble: https://github.com/cockpit-project/cockpit/issues/1160
omoris	Lenovo 430s (+VM)	pass ^[1]	pass ^[2]	↑ Password field should be cleared when incorrect password is used to log-in. ↑ Not very helpful error messages when changing roles, terminating session or deleting when logged in as newly created user.
rskvaril	Lenovo T440s	pass	pass ^[1]	↑ user can't change own avatar
bblaskov	openstack	fail ^{[long 1]}
alikins	f21-server-cockpit-virt-image		warn ^[1] ^[2]	↑ RHBZ #1142426 ↑ Extemely long "Real Name" for user account creation works, but causes display text wrapping issues.
konstantinjch	ASRock P67 Extreme4	pass	pass
pschindl	Lenovo ThinkPad T540p	pass	pass

Storage[edit]

User	Hardware	Monitor disk I/O	Create a RAID Device	Create a Logical Volume	References
Alich	Hewlett-Packard HP xw4600 Workstation	pass ^[1]	pass ^[2]	pass ^[3] ^[4]	↑ Graphs have no scale, some issues with live image on USB (data didn't follow reading/writing) ↑ RHBZ #1142396 ↑ RHBZ #1144472 ↑ RHBZ #1144481
jskladan	X230	pass	pass	pass
baoboa	HP workstation Z400	pass	pass	pass
jprokes	VPS	pass ^[1]	pass ^[2]	fail ^[3]	↑ RHBZ #1142228 ↑ RHBZ #1142251 ↑ RHBZ #1142297
roshi	virt-manager	pass	pass	pass
elemc	Gigabyte PH67-DS3-B3	pass	pass	pass
jscotka	lenovo T61	pass	pass	pass
rskvaril	Lenovo T440s	pass	pass ^[1]	pass	↑ RHBZ #1142248
alikins	f21-server-cockpit-virt-image		fail ^[1] ^[2] warn ^{[long 2]} warn ^[3] ^[4]		↑ RHBZ #1142459 ↑ Attempting to format a raid5 partition of loop devices that uses up all space fails mostly silently. ↑ RHBZ #1142443 ↑ Works, but a cosmetic issue: available block devices are listed in lexical order, so that 'loop10' precedes 'loop2'
konstantinjch	ASRock P67 Extreme4	pass	pass	pass
pschindl	Lenovo ThinkPad T540p	pass ^[1] pass	warn ^[2]	pass ^[3] ^[4]	↑ When I hover over the graph nothing happens (step 4 in test case). Also graphs don't contain any information about scale. ↑ RHBZ #1142236 ↑ RHBZ #1142259 ↑ It was hard to set size which would fill the whole volume (step 3).

Network[edit]

User	Hardware	Monitor network I/O	Create VLAN	Create Bond	References
jskladan	X230	pass	pass
baoboa	HP workstation Z400	pass	pass
jprokes	VPS	pass	pass ^[1]	pass	↑ I didn't expect cidr format of netmask when the field for this is so long.
todoleza	openstack/vps	fail ^[1] ^[2]			↑ RHBZ #1142798 ↑ unmanaged NetworkManager dependency
roshi	virt-manager	pass
elemc	Gigabyte PH67-DS3-B3	pass	pass	pass
jscotka	lenovo T61	pass	pass	pass
omoris	Lenovo 430s (+VM)	pass	pass	pass
rskvaril	Lenovo T440s	pass	pass
konstantinjch	ASRock P67 Extreme4	pass	pass	pass
pschindl	Lenovo ThinkPad T540p	pass

Docker[edit]

User	Hardware	Download and run image	Create a new image and run it	References
baoboa	HP workstation Z400	pass	pass
jprokes	VPS	pass ^[1] pass	pass	↑ RHBZ #1142362
dspurek	Lenovo 440s (+VM)	pass ^[1] ^[2]	pass	↑ RHBZ #1142209 ↑ downloaded image disappears after click on another tab
roshi	virt-manager	pass	pass
elemc	Gigabyte PH67-DS3-B3	pass	pass
lpol	openstack instances	pass ^[1]	pass	↑ RHBZ #1142129
jscotka	lenovo T61	pass	pass
omoris	Lenovo 430s (+VM)	pass	pass

Notes[edit]

We recommend that you install Fedora 21 Server since we would like you to also test whether Cockpit really works out of the box. Of course, if you would like to test Cockpit but would rather not go through the trouble of installing Fedora from scratch yet one more time, you can also add Cockpit to your existing Fedora system.

yum -y install cockpit docker-io fedora-dockerfiles wmdocker
firewall-cmd --permanent --add-service=cockpit
systemctl reload firewalld.service
systemctl start cockpit.socket
systemctl enable cockpit.socket

Long comments[edit]

↑ Some bugs which I found just by using cockpit (not relevant for this testcase) https://github.com/cockpit-project/cockpit/issues/1175 https://github.com/cockpit-project/cockpit/issues/1179 https://github.com/cockpit-project/cockpit/issues/1182
↑ Unclear if formatting needed to happen to the "Raid device" on the storage-detail page (Format is an option in it's drop down options) or the "Content" (defaults to "Format" option).

[bz1142175-1] RHBZ #1142175

[2] Useless logout message

[bz1142234-3] RHBZ #1142234

[bz1142208-4] RHBZ #1142208

[5] Problem with password change on multiple servers managed by cockpit.

[bz1142154-6] RHBZ #1142154

[7] unprivileged user can't change own password

[bz1142210-8] RHBZ #1142210

[bz1135444-9] RHBZ #1135444

[10] selinux, random log out

[bz1142229-11] RHBZ #1142229

[bz1142215-12] RHBZ #1142215

[bz1140562-13] 1.0 ^1.1 RHBZ #1140562

[14] second trouble: https://github.com/cockpit-project/cockpit/issues/1160

[15] RHBZ #[[rhbug:|]]

[16] second trouble: https://github.com/cockpit-project/cockpit/issues/1160

[17] Password field should be cleared when incorrect password is used to log-in.

[18] Not very helpful error messages when changing roles, terminating session or deleting when logged in as newly created user.

[19] user can't change own avatar

[bz1142426-21] RHBZ #1142426

[22] Extemely long "Real Name" for user account creation works, but causes display text wrapping issues.

[23] Graphs have no scale, some issues with live image on USB (data didn't follow reading/writing)

[bz1142396-24] RHBZ #1142396

[bz1144472-25] RHBZ #1144472

[bz1144481-26] RHBZ #1144481

[1]

[2]

[3]

[1]

[2]

[1]

[2]

[1]

[2]

[3]

[1]

[2]

[1]

[2]

[3]

[4]

[1]

[2]

[1]

[long 1]

[1]

[2]

[1]

[2]

[3]

[4]

[1]

[2]

[3]

[1]

[1]

[2]

[long 2]

[3]

[4]

[1]

[2]

[3]

[4]

[1]

[1]

[2]

[1]

[1]

[2]

[1]

@@ Line 99: / Line 99: @@
 ! User
 ! Hardware
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_Login Password change]
+! [[QA:Testcase_Cockpit_Login|Password change]]
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_Account Create user account]
+! [[QA:Testcase_Cockpit_Account|Create user account]]
 ! References
 |-
@@ Line 217: / Line 217: @@
 ! User
 ! Hardware
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_DiskIO Monitor disk I/O]
+! [[QA:Testcase_Cockpit_DiskIO|Monitor disk I/O]]
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_RAID Create a RAID Device]
+! [[QA:Testcase_Cockpit_RAID|Create a RAID Device]]
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_LVM Create a Logical Volume]
+! [[QA:Testcase_Cockpit_LVM|Create a Logical Volume]]
 ! References
 |-
@@ Line 308: / Line 308: @@
 ! User
 ! Hardware
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_NetworkIO Monitor network I/O]
+! [[QA:Testcase_Cockpit_NetworkIO|Monitor network I/O]]
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_VLAN Create VLAN]
+! [[QA:Testcase_Cockpit_VLAN|Create VLAN]]
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_Bond Create Bond]
+! [[QA:Testcase_Cockpit_Bond|Create Bond]]
 ! References
 |-
@@ Line 398: / Line 398: @@
 ! User
 ! Hardware
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_DockerImage Download and run image]
+! [[QA:Testcase_Cockpit_DockerImage|Download and run image]]
-! [http://fedoraproject.org/wiki/QA:Testcase_Cockpit_DockerCommit Create a new image and run it]
+! [[QA:Testcase_Cockpit_DockerCommit|Create a new image and run it]]
 ! References
 |-
@@ Line 466: / Line 466: @@
 <references group="long" />
-[[Category:Test Days]]
 [[Category:Fedora 21 Test Days|c]]

Search