From Fedora Project Wiki
Remarks By Topic
Visibility
- (-1) Tester #1, a new packager, had never heard of or used Fedora Community before the call for usability testers.
- (-1) Tester #2, an experienced packager, had never heard of or used Fedora Community before the call for usability testers.
- (+1) Tester #3, a new packager, had heard of Fedora Community on fedora-announce and also saw the adds on www.fedoraproject.org
- (-1) Tester #3, a new packager, asks for help a lot on IRC, and the experienced maintainers that help her show her how to use the old tools and never use Fedora Community, so she's more apt to use the other older tools.
- (-1) Tester #3, had only used Fedora Community 2x since launch.
- (-1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester3 | Tester #3] wouldn't think to use Fedora Community to search for someone - first instinct to ask on IRC or ask FASbot.
Branding
- (-1) Tester #1 thought the picture of Kyle was a little off-putting :)
- (-1) Tester #2 thought the picture of Kyle was scary
- (+1) Tester #1 felt the site was consistent with Fedora branding and recognizable as an official Fedora site.
- (+1) Tester #2 felt the site was consistent with Fedora branding and recognizable as an official Fedora site.
- (+1) Tester #2 felt the site was related to package maintenance.
- (-1) Tester #2 wasn't sure where to start or why he was on the site.
- (-1) Tester #3 was not sure what Fedora Community was when he first saw it. It's not clear from the name, and to a new packager the lingo is intimidating.
- (-1) Tester #3 wondering - why do we need a community? What more do we need? This doesn't seem associated with package management. We already have forums, mailing lists, etc.
User Profiles
- (-1) Tester #1 was a maintainer (not owner) of one package - sssd. He could not see sssd in his list of packages because he is just a maintainer. This would cause him issues using the site.
- (-1) Tester #1 had a group he should have been a member of missing from his group memberships list on his profile.
- (-1) Tester #1 at another point in his profile saw that sssd was listed as being owned rather than simply maintained by him. So there's an inconsistency somewhere between ownership and maintainership.
- (-1) Tester #1 experienced incredibly slow loading time for Luke Macken's profile. He clicks on it at 16:51 in the video, and it fails to load up until 18:00 in the video (1 minute 9 seconds wait!). He refreshes and it then loads very quickly.
- (+1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester2 | Tester #2]'s package listings and group memberships were correct.
- (-1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester2 | Tester #2] owns 8 packages, only saw 5 in the sidebar with a link to 'view more.' He would have liked maybe an in-place AJAX expander so he didn't have to load a new page to see all 8.
- (+1) Tester #2 was able to find out how many packages lmacken owns and whether or not there were unpushed updates for them.
- (+1) Tester #2 found the listing of IRC nicks very helpful.
- (+1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester3 | Tester #3]'s package listings and group memberships were correct.
- (+1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester3 | Tester #3] really liked that her blog was listed here - a pleasant surprise. It's good additional info to determine if another user is still active in the community or not as well.
- (-1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester3 | Tester #3] in progress builds are not as useful for me because i only own 3 packages
- (-1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester3 | Tester #3] would like to see her trac tickets here, but they're not there.
- (-1) Tester #3 unclear if it's possible to view only the packages the person owns, only the packages they maintain, or both.
Sidebar Widgets
- (-1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester2 | Tester #2] didn't have any interest in the 'all packages' widget in the sidebar - "Maybe Jesse would care about that. I don't."
- (-1) [[FedoraCommunity/UsabilityTestingRound1/UsabilityTester3 | Tester #3] found that on her profile, the 'go to my packages' widget in the right was labeled 'go to users packages' - BUG
- (-1) Tester #3 is there a difference between what the alerts and packages i own widgets are telling me, or is it just redundant?
- (-1) Tester #3 when clicking on lmacken's profile, on a link that indicated it would point to lmacken's succeeded builds - it brought her to *her* builds, not lmacken's. This bug seemed to affect all build and update links in that widget. BUG.
Search
- (-1) Tester #1 could not figure out Dennis Gilmore's FAS name using people search. He could not sort by first name or last name. He simply could not complete the task using the tool.
- (+1) Tester #1 very much liked that he could search for a package and see its subpackages as well.
- (-1) Tester #1, while searching for Luke, experienced noticeably slow search time. His search started at 16:35 in the video, and he didn't receive results until 16:51 in the video (16 second delay)
- (-1) Tester #1 experienced a very slow search time for 'ipa-server'. He starts his search at 23:23. The search continues to load up until 23:07 (44 sec!), at which point he gives up and hits the back button. Firefox appears to lock up slightly. This sucks as well, it goes on to reload the page he had been on previously (sssd package details), the page takes from 23:07-24:02 in the video to reload (55 sec!)
- (-1) Tester #2 made several attempts to find Dennis Gilmore's FAS name using search with no luck.
- (-1) Tester #2 found pagination on the bottom of search results page very difficult to see.
- (0) Tester #2 for package results, would have liked to see the maintainer's name listed by the package in the results page - would asve him a click and a page load since that is what he's usually looking for.
- (-1) Tester #2 misspelled yelp while looking for it, and the search return nothing. It is very unforgiving for misspelling.
- (+1) Tester #2 was easily able to lmacken via search.
- (-1) Tester #2 clicked on search in the lower left and for the first time saw the search guide. Whoops. First instinct was to use searchbox at the top which means otherwise he'd never have seen those instructions.
- (+1) Tester #3, found Fedora Community very helpful in looking up information about package maintainers in the past.
- (-1) Tester #3 found that people search doesn't work without being logged in, and it doesn't advertise that people search is possible at all if you try to use it while not logged in. it's a very valuable part of the site...
- (-1) Tester #3 made several attempts to find Dennis Gilmore's FAS name using search with no luck.
- (+1) Tester #3 was able to find yelp with no trouble.
- (+1) Tester #3 was able to find lmacken's profile with no trouble.
- (+1) Tester #3 was happy to note that search didn't require caps for 'Network Manager' and was able to find it without trouble.
- (+1) Tester #3 had no problem finding ruby.
People Directory
- (-1) Tester #1 took one look at it and didn't even attempt to use it, he jumped straight to search.
- (-1) Tester #2 could not find Dennis Gilmore using the people directory - difficult and slow to browse.
Package Details
- (-1) Tester #1 would have liked to see a listing of what packages a build of the package would kick off rebuilds for based on dependencies.
- (-1) Tester #1 could not find a link to Fedora 9 releases for a package because it is a now-retired release. there was no link to an archive or a way to view the 'active releases' table across ALL fedora releases.
- (0) Tester #1 noted maintainers list for yelp is quite long.
- (-1) Tester #1 experienced a slow loading time for the bugs tab of package details. He clicks on it at 19:56 in the video, and it doesn't fully load until 20:20 (24 seconds!)
- (+1) Tester #1 found it very easy to access ruby's changelog.
- (-1) Tester #2 could not find Fedora 9 (retired release) information on inkscape active releases widget.
- (-1) Tester #2 did not know that the 'builds' link with the koji icon in the center of the page linked out externally to koji - he would have retreated there to find Fedora 9 release version information for inkscape there since it wasn't in active releases. Also, there was no link to koji in the builds pages for the package.
- (-1) Tester #2 the updates page for the package didn't have a link to that package's details in bodhi.
- (-1) Tester #2 the SRPM is not on the 'sources' tab of the package. An obvious place to look for it.
- (+1) Tester #2 was easily able to find maintainer's name right on the front page of package details.
- (+1) Tester #2 was able to the bugs dashboard for NetworkManager on first try.
- (-1) Tester #2 found package bugs tab very slow to load (but understands that BZ is slow in general)
- (-1) Tester #2 did not notice the changelog menu item, and clicked over to the spec to view it rather than see the nicely formatted one. Changelog is under maintenance tools - perhaps it belongs in details?
- (-1) Tester #2 clicked on updates in main content area to go offsite to bodhi - did not notice the 'updates' link in the right sidebar that keeps you inside fedora community
- (-1) Tester #3 could not find Fedora 9 (retired release) information on inkscape active releases widget.
- (-1) Tester #3 was confused by the external links bar in the package details page. Clicked on source to find SRPM and instead ended up on viewcvs - did not notice source item in right toolbar that would have kept her inside Fedora Community.
- (-1) Tester #3 confused by the difference between maintainers and owners, especially in the right sidebar - not sure which to click.
- (-1) Tester #3 noticed the external-linking 'bugs' icon for Bugzilla in the main content area before the Fedora-Community-centric bugs dashboard item in the right sidebar 'Bugs' - whoops. Our bugs dashboard is a better experience.
- (-1) Tester #3 confused by the placement of the bugs nav item for package details. It's not really package maintenance, more helping out with a package to report a bug?
- (-1) Tester #3 looked for a changelog on the updates page - nothing.
- (-1) Tester #3 wanted a way to get a diff for changelog - there isn't a way to do this now.
- (0) Tester #3 did not see right nav 'changelog' nav item, found changelog during second attempt looking at the main content area for package details landing page.
Package Maintenance
- (-1) Tester #1 was unable to find 'unpushed updates' for packages he owned, and ended up searching for individual packages to get the information.
- (-1) Tester #1, when navigating from a package details page, had a bit of trouble finding a list of all the builds of packages related to him.
- (-1) Tester #1 wasn't sure what to do in order to check up on someone else's packages. He would have liked to see some kind of alerts system, email based maybe, to let him know what needs attention.
- (-1) Tester #1 wanted to be able to kick off package builds and didn't see a way how.
- (-1) Tester #1 also wanted to be able to kick off rebuilds, eg if the deps bumped because of an .so file change.
- (-1) Tester #1 wanted to be able to view a dependency tree for a given package.
- (+1) Tester #2 was able to find his unpushed updates via 'my pending updates' in the right sidebar of his profile.
- (+1) Tester #2 was able to find a list of all his builds by looking at the right bar of his profile and clicking on builds - overview.
- (0) Tester #2 was unsure if the 'in-progress builds' widgets/page would automatically update or if he'd have to refresh the page to get updated information on those builds.
- (+1) Tester #3 was able to find her unpushed updates via 'my pending updates' in the right sidebar of her profile ('packages i own').
- (+1) Tester #3 was able to find her builds via the alerts right sidebar in her profile.
- (-1) Tester #3 had no idea what karma was and could not finding it using search nor searching in a package details page using Firefox to scan the page.
- (-1) Tester #1 ended up getting confused when he was looking at a package details page, clicked on 'package maintenance', and was brought to the package details overview page rather than the main / all-packages overview page.
- (+1) Tester #3 found that both the left nav 'my profile' item and her name in the upper right corner brought her to her profile - she was pleased with this as she prefers using the link in the upper right.
Overall Site Functionality
- (0) Tester #1 noted the site seemed more about monitoring than *doing*.
- (+1) Tester #2 likes how the site keeps all the information in one spot rather than across different systems (koji, bodhi, pkgdb)
- (+1) Tester #2 likes how in Fedora Community, if you're not sure how to do something the 'Fedora Community way' it's very easy to revert back to the old way of doing things with the links to pkgdb, koji, bodhi, etc
- (-1) Tester #2 thinks the fonts are a little small
- (-1) Tester #2 would like the text to be easier to scan.
- (+1) Tester #2 likes that Fedora Community is not another password/login - uses the same account he's used to using for Fedora.
- (-1) Tester #3 would like to see more documentation/tutorials geared towards new package maintainers to not only help them use the site, but learn how to maintain a package.
- (0) Tester #3 was at first unsure if she already had a login for the site.
- (-1) Tester #3 visited the create new login page, dumps you over to the FAS site which looks completely different - very bewildering for a new user. Doesn't tell her what she's signing up for.
- (-1) Tester #3 very confused by the concept of karma and disappointed about documentation turned up when she searched the web for it.
Remarks By Implication
The Good
- (+1) Tester #1 found it very easy to access ruby's changelog.
- (+1) Tester #1 very much liked that he could search for a package and see its subpackages as well.
- (+1) Tester #1 felt the site was consistent with Fedora branding and recognizable as an official Fedora site.
The Bad
- (-1) Tester #1 was unable to find 'unpushed updates' for packages he owned, and ended up searching for individual packages to get the information.
- (-1) Tester #1, when navigating from a package details page, had a bit of trouble finding a list of all the builds of packages related to him.
- (-1) Tester #1 wasn't sure what to do in order to check up on someone else's packages. He would have liked to see some kind of alerts system, email based maybe, to let him know what needs attention.
- (-1) Tester #1 wanted to be able to kick off package builds and didn't see a way how.
- (-1) Tester #1 also wanted to be able to kick off rebuilds, eg if the deps bumped because of an .so file change.
- (-1) Tester #1 wanted to be able to view a dependency tree for a given package.
- (-1) Tester #1 ended up getting confused when he was looking at a package details page, clicked on 'package maintenance', and was brought to the package details overview page rather than the main / all-packages overview page.
- (-1) Tester #1 experienced a slow loading time for the bugs tab of package details. He clicks on it at 19:56 in the video, and it doesn't fully load until 20:20 (24 seconds!)
- (-1) Tester #1 would have liked to see a listing of what packages a build of the package would kick off rebuilds for based on dependencies.
- (-1) Tester #1 could not find a link to Fedora 9 releases for a package because it is a now-retired release. there was no link to an archive or a way to view the 'active releases' table across ALL fedora releases.
- (-1) Tester #1 took one look at it and didn't even attempt to use it, he jumped straight to search.
- (-1) Tester #1, while searching for Luke, experienced noticeably slow search time. His search started at 16:35 in the video, and he didn't receive results until 16:51 in the video (16 second delay)
- (-1) Tester #1 experienced a very slow search time for 'ipa-server'. He starts his search at 23:23. The search continues to load up until 23:07 (44 sec!), at which point he gives up and hits the back button. Firefox appears to lock up slightly. This sucks as well, it goes on to reload the page he had been on previously (sssd package details), the page takes from 23:07-24:02 in the video to reload (55 sec!)
- (-1) Tester #1 could not figure out Dennis Gilmore's FAS name using people search. He could not sort by first name or last name. He simply could not complete the task using the tool.
- (-1) Tester #1 was a maintainer (not owner) of one package - sssd. He could not see sssd in his list of packages because he is just a maintainer. This would cause him issues using the site.
- (-1) Tester #1 had a group he should have been a member of missing from his group memberships list on his profile.
- (-1) Tester #1 at another point in his profile saw that sssd was listed as being owned rather than simply maintained by him. So there's an inconsistency somewhere between ownership and maintainership.
- (-1) Tester #1 experienced incredibly slow loading time for Luke Macken's profile. He clicks on it at 16:51 in the video, and it fails to load up until 18:00 in the video (1 minute 9 seconds wait!). He refreshes and it then loads very quickly.
- (-1) Tester #1 thought the picture of Kyle was a little off-putting :)
- (-1) Tester #1, a new packager, had never heard of Fedora Community before the call for usability testers.