From Fedora Project Wiki

(Drop direct Test Days category membership)
 
(41 intermediate revisions by 12 users not shown)
Line 18: Line 18:
* Development - [[User:Lmacken]], [[User:Skvidal]], [[User:Jdieter]]
* Development - [[User:Lmacken]], [[User:Skvidal]], [[User:Jdieter]]
* Quality Assurance - [[User:Psklenar]], [[User:Jhutar]], [[User:Adamwill|Adam Williamson]]
* Quality Assurance - [[User:Psklenar]], [[User:Jhutar]], [[User:Adamwill|Adam Williamson]]
* Others on #presto-test on server freenode


== Prerequisites for Test Day ==
== Prerequisites for Test Day ==
Line 24: Line 25:


* Where to get F11 Beta: https://fedoraproject.org/en/get-prerelease ([http://mirrors.fedoraproject.org/publiclist/Fedora/11-Beta/ all mirrors])
* Where to get F11 Beta: https://fedoraproject.org/en/get-prerelease ([http://mirrors.fedoraproject.org/publiclist/Fedora/11-Beta/ all mirrors])
* Where to get ''yum-presto'' (it is not in the Beta): http://koji.fedoraproject.org/koji/buildinfo?buildID=93831 (or check [http://mirrors.fedoraproject.org/publiclist/Fedora/development/ development repo] if you need some dependencies) or 'yum install yum-presto --enablerepo=rawhide'
* Where to get ''yum-presto'' (it is not in the Beta): http://koji.fedoraproject.org/koji/buildinfo?buildID=93831 (or check [http://mirrors.fedoraproject.org/publiclist/Fedora/development/ development repo] if you need some dependencies) or <pre>yum --enablerepo=rawhide install yum-presto</pre>
{{admon/warning|You will be removing packages, make sure not to remove any important ones like kernel, glibc and so on - it happened before!}}
* Make sure you are running deltarpm-3.4-15 ('rpm -q deltarpm'): <pre>yum --enablerepo=rawhide update deltarpm</pre>
* Create a F11 Snapshot1 Presto repo configuration (e.g. edit /etc/yum.conf):
=== i386 ===
<pre>cat <<EOF> /etc/yum.repos.d/fedora-presto-testday.repo
[PrestoTestDay]
name=PrestoTestDay F11 Snapshot1 with drpms
baseurl=http://people.redhat.com/psklenar/repodata/i386/Packages
enabled=1
gpgcheck=0
EOF
</pre>
=== x86_64===
<pre>cat <<EOF> /etc/yum.repos.d/fedora-presto-testday.repo
[PrestoTestDay]
name=PrestoTestDay F11 Snapshot1 with drpms
baseurl=http://skvidal.fedorapeople.org/presto-test/x86_64/Packages/
enabled=1
gpgcheck=0
EOF
</pre>


== How to test? ==


What do we want to test exactly? We want to ensure, that packages serching/installing/updating/uninstalling works, that it works in all the different ways users are using it and that Presto related tools also works.


=== Test ===
{{admon/warning|Remove with caution|You will be removing packages, make sure not to remove any important ones like kernel, glibc and so on - it happened before!}}


==== Update F11 Beta system to F11 Snapshot1 ====
== How to test? ==
# Start with the F11 Beta system
#* if you have rawhide older than Beta, please update to the Beta first: https://fedoraproject.org/en/get-prerelease
# Set-up our repo with pre-generated presto metadata
# Ensure you have yum-presto plugin installed and available
# Update the system - yum should be downloading ''*.drpm'' files instead of ''*.rpm'' ones
#* You may test it on a single package first (yum list updates, choose one and then yum update <choosed package>)


==== on command-line ====
What do we want to test exactly? We want to ensure, that packages serching/installing/updating/uninstalling works, that it works in all the different ways users are using it and that Presto related tools also works.
See this test-plan: [[QA:Testcase_YumPresto_basics_cmd]]


==== with PackageKit ====
* [[QA:Testcase_YumPresto_basics_cmd]]
# rpm -q yum yum-presto PackageKit PackageKit-yum PackageKit-yum-plugin gnome-packagekit ...
* [[QA:Testcase_YumPresto_PackageKit]]
# Try to search/install/upgrade/remove few packages (test it as a non root user) in gnome-packagekit (System -> Administration -> Add/Remove Software)
*# rpm -q yum yum-presto PackageKit PackageKit-yum PackageKit-yum-plugin gnome-packagekit ...
*# Try to search/install/upgrade/remove few packages (test it as a non root user) in gnome-packagekit (System -> Administration -> Add/Remove Software)
* [[QA:Testcase_YumPresto_yumex]]
*# rpm -q yum yum-presto yumex ...
*# Try to search/install/upgrade/remove/group* few packages using your favourite GUI tool (e.g. yumex)
* [[QA:Testcase_YumPresto_createrepo]]


==== with other GUI tools ====
{{admon/note|Dependencies?|  You will need ''[http://koji.fedoraproject.org/koji/buildinfo?buildID=98103 createrepo-0.9.7-4.fc11]'' or newer from [http://koji.fedoraproject.org/koji/packageinfo?packageID=603 koji] (older ones had a bug)}}
# rpm -q yum yum-presto yumex ...
# Try to search/install/upgrade/remove/group* few packages using your favourite GUI tool (e.g. yumex)
 
==== related tools ====
Note: you will need ''[http://koji.fedoraproject.org/koji/buildinfo?buildID=98103 createrepo-0.9.7-4.fc11]'' or newer from [http://koji.fedoraproject.org/koji/packageinfo?packageID=603 koji] (older ones had a bug).
 
# rpm -q createrepo presto-utils
# Create a repository from few packages you have
# Try to use that repository


== Results ==
== Results ==
Line 66: Line 73:


{|
{|
! user !! command/action !! system !! downloaded !! time !! relevant packages versions !!
! user !! command/action !! system !! downloaded !! time !! relevant packages versions !! other plugins
|-
| [[Used:Tester1]] || <code>yum search yum</code> || Intel Core 2 DUO 2.20GHz, 2GB RAM, ... || during the command run, I have downloaded ???kB || real 0m1.094s, user 0m0.832s, sys 0m0.148s || yum-3.2.21-2.fc10.noarch yum-presto-0.4.5-1.fc9.noarch, yum-fastestmirror-1.1.19-1.fc10.noarch || and few other plugins
|-
|-


Line 77: Line 82:
|-
|-


| [[Used:Tester1]] || <code>...</code> || ... || ... || ... || ... || ...
| [[User:mnowak | Michal Nowak]] || <code>yum upgrade kernel</code> || host(Rawhide.x86_64) + guest(KVM/F-11-Beta.x86_64) || 22 MB v. 9.7 MB saved 57 % || the rebuilding rpms from deltas took ~2 mins, but probably worth the savings || yum-3.2.21-16.fc11 & yum-presto-0.4.5-4.fc11 || refresh-packagekit
|-
 
| [[User:mnowak | Michal Nowak]] || <code>yum upgrade openoffice.org\*</code> || host(Rawhide.x86_64) + guest(KVM/F-11-Beta.x86_64) || 129 MB v. 11 MB saved 92 % || the rebuilding rpms from deltas took ~3 mins, but definitely worth the savings || yum-3.2.21-16.fc11 & yum-presto-0.4.5-4.fc11 || refresh-packagekit
|-
 
| [[User:mnowak | Michal Nowak]] || <code>yum upgrade \*PackageKit\* \*gnome-packagekit\*</code> || host(Rawhide.x86_64) + guest(KVM/F-11-Beta.x86_64) || 4 MB v. 1.3 MB saved 69 % ||  || yum-3.2.21-16.fc11 & yum-presto-0.4.5-4.fc11 || refresh-packagekit
|-
 
| [[User:mmaslano | Marcela Maslanova]] || <code>time yum update -y sos --enablerepo=myrepo</code> || rawhide  2.6.29.1-70.fc11.x86_64 || downloaded 54K, would have been downloaded 185K, savings of 71 percent || real 0m22.392s user 0m7.605s sys 0m1.277s || yum-presto-0.4.5-4.fc11.noarch, yum-3.2.22-1.fc11.noarch || no other plugins
|-
 
| [[User:psklenar | Petr Sklenar]] || <code>[http://fpaste.org/paste/9264 yum update]</code> || rawhide  2.6.29.1-70.fc11.x86_64; +-beta.i386 to people.redhat.com/psklenar/repodata/i386 || downloaded 120M, would have been downloaded 305M, savings of 61 percent ||  || yum-presto-0.4.5-4.fc11.noarch, yum-3.2.22-1.fc11.noarch || no other plugins
|-
 
| Riku Seppälä || <code>yum update openoffice*</code> || 2.6.29-0.258.2.3.rc8.git2.fc11.x86_64  || downloaded 11M, would have been downloaded 129M, savings of 92 percent || N/A || yum-3.2.22-4.fc11.noarch yum-presto-0.4.5-4.fc11.noarch || no other plugins
|-
 
| [[User:jhutar]] || <code>yum update</code> || 8xXeon CPU E5320@1.86GHz, 1GB RAM (from F11Beta to F11Snap1, i386 system, 664 packages) || downloaded 130M, would have been downloaded 345M, savings of 63 percent || real 21m17.767s, user 9m28.387s, sys 0m56.330s || Beta yum + yum-presto-0.4.5-4.fc11 || no other plugins
|-
 
| [[User:Lmacken]] || <code>yum update</code> || Tested on both KDE and GNOME F11 Beta spins, upgrading to F11snap1 || Downloaded 197M, would have been 407M.  Savings of 52% || N/A ||  yum-presto-0.4.5-4.fc11, deltarpm-3.4.15.fc11 ||
|-
 
| [[User:gsreekantan | Gireesh Sreekantan]] || <code>yum update</code> || Tested updating Beta (Fedora 10.92) to snap 1 with GNOME and LXDE installed - KVM guest|| Downloaded 197M, would have been 408M.  Savings of 52%. yum update transmission gave a savings of 38% || Rebuiling took 20minutes - maybe due to KVM ||  yum-presto-0.4.5-4.fc11, deltarpm-3.4.15.fc11 || refresh-packagekit, presto plugins installed
|-
 
| [[User:jhutar]] || [[QA:Testcase_YumPresto_basics_cmd|basics]] || 8xXeon CPU E5320@1.86GHz, 1GB RAM || as expected || no performacne problems observed || yum-presto-0.4.5-4.fc11 || refresh-packagekit
|-
 
| [[User:jhutar]] || <code>yum update</code> || 4 x Xeon CPU X3353@2.66GHz; 4GB RAM (from F11Beta to F11Snap1, x86_64 system, 1124 packages) || Downloaded 221M, would have been downloaded 799M, savings of 73 percent || real 28m58.142s, user 15m52.641s, sys 2m3.990s || yum-3.2.22-4.fc11.noarch, yum-presto-0.4.5-4.fc11.noarch || no other plugins
|}
|}


[[Category:Test_Days]]
[[Category:Fedora 11 Test Days]]

Latest revision as of 21:15, 26 June 2015

DATE TIME WHERE
2009-04-16 (Thu) From 12:00 to 21:00 UTC (8am -> 5pm EDT) #fedora-qa)

What to test?[edit]

Today's instalment of Fedora Test Day will focus on:

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Prerequisites for Test Day[edit]

You will need a Fedora 11 Beta system with root access (as we are going to work with yum and rpm). You should have your favourite package set installed. We will provide a repo with F11 Snapshot1 packages with delta RPMs and presto metadata generated, so everybody can do Beta -> Snapshot1 upgrade. Unfortunately there is no live CD for this test day, as you need an installed system to properly test this feature.

i386[edit]

cat <<EOF> /etc/yum.repos.d/fedora-presto-testday.repo
[PrestoTestDay]
name=PrestoTestDay F11 Snapshot1 with drpms
baseurl=http://people.redhat.com/psklenar/repodata/i386/Packages
enabled=1
gpgcheck=0
EOF

x86_64[edit]

cat <<EOF> /etc/yum.repos.d/fedora-presto-testday.repo
[PrestoTestDay]
name=PrestoTestDay F11 Snapshot1 with drpms
baseurl=http://skvidal.fedorapeople.org/presto-test/x86_64/Packages/
enabled=1
gpgcheck=0
EOF


Remove with caution
You will be removing packages, make sure not to remove any important ones like kernel, glibc and so on - it happened before!

How to test?[edit]

What do we want to test exactly? We want to ensure, that packages serching/installing/updating/uninstalling works, that it works in all the different ways users are using it and that Presto related tools also works.

Dependencies?

Results[edit]

We will store results in the table below. This page is editable without a Fedora login for those who do not want to sign the CLA, but if you do have a FAS account, please log in before editing.

If you find a bug, please report it through Bugzilla and make it depend on bug PrestoTestDay (just put PrestoTestDay into the Blocks: field). If you do not have an account there, you may create one, or just ask somebody on the #fedora-qa to report the bug for you.

user command/action system downloaded time relevant packages versions other plugins
Markino (aka TopoMorto) yum update VirtualBox 2.2 ... ???kB real 14m51.956s, user 2m46.799s, sys 1m32.895s yum-3.2.22-4.fc11.noarch yum-presto-0.4.5-4.fc11.noarch, yum-fastestmirror-1.1.21-2.fc11.noarch no other plugins
Petr Lautrbach yum update kvm-74-11.fc10.x86_64, guest - x86_64, 512M Ram downloaded 236M, would have been downloaded 262M, savings of 10 percent N/A yum-presto-0.4.5-4.fc11.noarch, yum-3.2.22-1.fc11.noarch -
Michal Nowak yum upgrade kernel host(Rawhide.x86_64) + guest(KVM/F-11-Beta.x86_64) 22 MB v. 9.7 MB saved 57 % the rebuilding rpms from deltas took ~2 mins, but probably worth the savings yum-3.2.21-16.fc11 & yum-presto-0.4.5-4.fc11 refresh-packagekit
Michal Nowak yum upgrade openoffice.org\* host(Rawhide.x86_64) + guest(KVM/F-11-Beta.x86_64) 129 MB v. 11 MB saved 92 % the rebuilding rpms from deltas took ~3 mins, but definitely worth the savings yum-3.2.21-16.fc11 & yum-presto-0.4.5-4.fc11 refresh-packagekit
Michal Nowak yum upgrade \*PackageKit\* \*gnome-packagekit\* host(Rawhide.x86_64) + guest(KVM/F-11-Beta.x86_64) 4 MB v. 1.3 MB saved 69 % yum-3.2.21-16.fc11 & yum-presto-0.4.5-4.fc11 refresh-packagekit
Marcela Maslanova time yum update -y sos --enablerepo=myrepo rawhide 2.6.29.1-70.fc11.x86_64 downloaded 54K, would have been downloaded 185K, savings of 71 percent real 0m22.392s user 0m7.605s sys 0m1.277s yum-presto-0.4.5-4.fc11.noarch, yum-3.2.22-1.fc11.noarch no other plugins
Petr Sklenar yum update rawhide 2.6.29.1-70.fc11.x86_64; +-beta.i386 to people.redhat.com/psklenar/repodata/i386 downloaded 120M, would have been downloaded 305M, savings of 61 percent yum-presto-0.4.5-4.fc11.noarch, yum-3.2.22-1.fc11.noarch no other plugins
Riku Seppälä yum update openoffice* 2.6.29-0.258.2.3.rc8.git2.fc11.x86_64 downloaded 11M, would have been downloaded 129M, savings of 92 percent N/A yum-3.2.22-4.fc11.noarch yum-presto-0.4.5-4.fc11.noarch no other plugins
User:jhutar yum update 8xXeon CPU E5320@1.86GHz, 1GB RAM (from F11Beta to F11Snap1, i386 system, 664 packages) downloaded 130M, would have been downloaded 345M, savings of 63 percent real 21m17.767s, user 9m28.387s, sys 0m56.330s Beta yum + yum-presto-0.4.5-4.fc11 no other plugins
User:Lmacken yum update Tested on both KDE and GNOME F11 Beta spins, upgrading to F11snap1 Downloaded 197M, would have been 407M. Savings of 52% N/A yum-presto-0.4.5-4.fc11, deltarpm-3.4.15.fc11
Gireesh Sreekantan yum update Tested updating Beta (Fedora 10.92) to snap 1 with GNOME and LXDE installed - KVM guest Downloaded 197M, would have been 408M. Savings of 52%. yum update transmission gave a savings of 38% Rebuiling took 20minutes - maybe due to KVM yum-presto-0.4.5-4.fc11, deltarpm-3.4.15.fc11 refresh-packagekit, presto plugins installed
User:jhutar basics 8xXeon CPU E5320@1.86GHz, 1GB RAM as expected no performacne problems observed yum-presto-0.4.5-4.fc11 refresh-packagekit
User:jhutar yum update 4 x Xeon CPU X3353@2.66GHz; 4GB RAM (from F11Beta to F11Snap1, x86_64 system, 1124 packages) Downloaded 221M, would have been downloaded 799M, savings of 73 percent real 28m58.142s, user 15m52.641s, sys 2m3.990s yum-3.2.22-4.fc11.noarch, yum-presto-0.4.5-4.fc11.noarch no other plugins