Testing

Typical User Testing Client Testing Classmate Testing Hardware and Software Testing

Typical User Testing

Target Market

The primary target audience is people with HIV/AIDS in Sonoma County, or people at risk for HIV/AIDS in Sonoma County. The site also targets students and community members interested in HIV protection, community volunteers, event attendees and individual and corporate sponsors. The eclectic nature of this audience means that the design and layout must be representative of the general population, and assumptions regarding values, attitudes and even computer skill must be avoided.

Testers

We requested 10 names from Face to Face and we received 8. Of the 8 offered, 5 responded. Many of the testers appeared to be affiliated with professionally or employed by Face to Face, none appeared to be those that access their services. This is completely understandable given the confidential nature of their work, but it might affect the result of this report given that they are not traditional "typical users."

I did receive one additional questionnaire after the report had already been compiled, but it was not from one of the initial email addresses supplied by Face to Face so it was discarded.

Testing Conditions

The conditions of the test were simple. We provided the supplied testers with a questionnaire and a link to the test site on May 2nd and asked that they reply by Friday May 6th. I also asked that if the tester did not think that they could complete the survey in the time allowed, that they email and let me know. This way we could schedule an extension if needed or get a replacement tester from Face to Face. I then sent out an email on May 5th to those testers that had not responded yet, giving them a courteous reminder that we had not received their questionnaire and would appreciate their cooperation.

The Hardware, software and connection speed of the testers is as follows:

Monitor Size Operating System Browser Version Internet
15" Laptop Windows 7 Internet Explorer 9 High Speed
24" Firefox 3.6.17 Windows 7 2 Mb/S
13" Firefox 4 Mac Snow Leopard OSX 10.6.7 Satellite
19" Internet Explorer (version not reported) Windows (version not reported) Ethernet
18" Internet Explorer (version not reported) Windows Vista Home Premium High Speed

Typical User Testing Results

  1. What are you overall impressions of the web site? (please be detailed)
    1. My first reaction was to the scrolling images they drive me nuts, very distracting. Slowing it down might help but I doubt it. User driven changes as you select the area of interest would help.
    2. Organization is concise/Like the rotating centerpiece image/clear navigation structure/every page is framed the same way with navigation consistency
    3. -Love the change in layout. Clear clean, easy to see things
      -Feels like too many different fonts are being used
      -Too many different colors for my taste, Donate now should be in a contrast color but the others are to varied
      -Slideshow tabs should be links
      -Face to Face font at top does not look right. Too thin compared to existing site. Important to keep the logo the same for branding purposes
      -I don’t understand the dual menus that are not consistent. A bit much/confusing. What if the lower portion under the slideshow were client testimonials
      -On the about us page, is there a more visually interesting way to do the timeline. Perhaps a hover over reveal? Something?
      -Staff and board page too much space between the columns and dots don’t match up
      I don’t think we should put volunteers on the site unless someone is willing to update continually
      -Testimonials – I question whether someone will read full letters. If kept as is, can excerpt quotes on home page?
      -Services section and pages tabs say About US
      -Get involved page- All page tabs say ’about us’
      -Why does the volunteer page have an ALC photo. That makes no sense at all since that event is not affiliated with us nor do we benefit from it. I think an image of someone helping a fake client is better
      -Instead of separate pages for the BTL images, why not embed a slideshow of them on the volunteer page? The heading as such and a caption for each?
      -Right now the BTL page is indicated as under the events section, is that where it should be?
      -About the photographer page is misspelled
      -Click here for application in Spanish should be IN SPANISH
      -The Advocacy Page needs an introductory sentence about Face to Face being the facilitating or lead agency in promoting increased advocacy for HIV/AIDS needs in the County through VOICE. Then the Mission heading should probably be “Program Mission” or something like that cuz right now, if I went right to this page somehow, it isn’t clear if it’s -F2F Mission or the project.
      -AFL tab says AFL 2010 not 2011
      -Beerfest tab say about us
      -Human race tab says events
      -SF gay mens chorus tab says about us
      -More upcoming events page tab says about us
      -Partnership page- I am not sure I like the chain image- a bit cold for our culture. Can we find a picture of people working together collaboratively?
      -Press page-a photo of a newspaper…really? It’s practically like having a picture of a dinosaur!….why not a screen shot of a collage of media home pages, like what Apple does with its favorite sites display? Something more current….
    4. It looks professional and conveys the diversity of services
    5. Beautiful. Friendly. Gets me where I want to go fast. I LOVE the scrolling pictures on the home page. Very informational.
  2. Does the site have a good balance of graphics versus text?
    1. Yes but the photo for services is quite nice what is it meant to convey? The spiral of stones is a nice graphic but to a new user doesn’t convey a message. The other images are fine.
    2. Reasonable balance, consider the structure is replicated on each page
    3. I think so
    4. Yes
    5. Yes
  3. Are the colors used throughout the site attractive?
    1. Yes the basic color is fine but could be a bit stronger for my taste
    2. I personally find the f2f blue scheme very dull, but you have found a way to complement it with more attractive colors
    3. Too Many Colors
    4. Yes
    5. Yes
  4. Does the main navigation make it easy to travel around the site?
    1. Yes
    2. Very logical/It is somewhat confusing to have what seem to be 4 navigation buttons under the rotating image on home page. I realized after a bit that this are only highlighted in rotation with the image. If they were supposed to be links, they did not work for me.
    3. No
    4. Yes
    5. Yes
  5. Can you get to information Quickly?
    1. Yes
    2. In most cases you are only one click from deep dive information
    3. I think so, however I wonder about the redundancy of info
    4. Yes
    5. Yes
  6. Does the site have a clear purpose?
    1. Yes, “Donate Now” but I’m not sure that we want that message to lead the show.
    2. Yes, but perhaps the mission statement text can be highlighted or made more obvious
    3. (no response)
    4. To inform about Face to Face
    5. Yes
  7. Can you find information about “ Rapid HIV Testing: day, hours, and location?” If yes, where?
    1. Yes in the left Calendar and also under services
    2. Yes, it is under the NEW category on the right
    3. I tried to go from the slide show but when I clicked the tab it did not go anywhere. I had to click the big image to get there.
    4. I first found it from the link on the calendar – from the home page
    5. In two or three places: Under “Calendar” Under “NEW” In the subheading line when you click on Services tab. Also on the scrolling photos.
  8. Where can you find the main donation link?
    1. Upper left of home page
    2. It’s on every page in the same place on the left
    3. On the Home Page
    4. On the home page (and every page) in bright orange
    5. Orange box on the left strip and under the Get Involved tab.
  9. Where can you find the office location map (Google Map)?
    1. “Contact” probably should read “Contact Us”
    2. Under contact us/Perhaps you need a shortcut link to location on the home page, especially as relates to HIV testing?
    3. Contact us
    4. Under Contact Us
    5. Contact Tab
  10. Can you find an Event called “Art for Life”? If yes, where?
    1. Under Events
    2. Under event link at both top and bottom of the home page
    3. Home page link and events section
    4. On the home page on the lower half under events and after clicking the Events tab at the top
    5. Under Calendar on the left, and under the Events tab. And it is one of the scrolling photos.
  11. Do all of the links work? If not, please let us know.
    1. Yes
    2. It is somewhat confusing to have what seem to be 4 navigation buttons under the rotating image on home page. I realized after a bit that this are only highlighted in rotation with the image. If they were supposed to be links, they did not work for me.
    3. I didn’t click through all of them on the site so cant report on each one
    4. Yes
    5. All the ones I tried worked.
  12. Did you find any typos?
    1. No, but I can't spell
    2. No
    3. I didn’t read ALL the text and will gladly do so if you need that
    4. Under press release the one about the 23rd annual Art For Life says “23ed”
    5. (Tester supplied additional document of errors found after proofreading, corrections have already been made)
  13. What are the three things you like best about the Web site?
    1. Tester 1
      1. Good description of what we do.
      2. Ease of getting around.
      3. No more than two clicks to get to the information.
    2. Tester 2
      1. Easy navigation
      2. concise presentation of all content on homepage
      3. rotating image
    3. Tester 3
      1. It’s fresh and new and far more intuitive and functional and I particularly appreciate NOT having a home page that scrolls down forever!!!
      2. (No response given)
      3. (No response given)
    4. Tester 4
      1. The layout
      2. The tabs spread out across the top
      3. The ability to access information/the same pages from various places
    5. Tester 5
      1. The scrolling pictures on the home page.
      2. The clear tabs to other sections.
      3. The fact that you can get to some things in more than one way.
  14. If you could make one significant change to this Web site, what change would you make?
    1. Maybe rethink the location of the “Donate Now” button work on the active graphic on the home page. Some of the text is a bit small i.e. the calendar. The text may need to have a bit more contrast to make it pop out better.
    2. Consider making the 4 boxes under the rotating image links to those pages
    3. (No response given)
    4. the most important to me would be making the mission stand out more.
    5. I would change the font of Face to Face Sonoma County AIDS Nework at the very top. In my opinion, it is too austere, conservative.
  15. Do you have any other questions or comments about the Web site or your experiences with it?
    1. Good job.
    2. Not clear what Sacks on the Square is, so that ma require some more elaboration
    3. (No response given)
    4. -When I go from the home page to the “Get Involved” tab to “shop for a cause” from the list, it goes to a funny page with the text narrow on the left and a large space between the text and pictures…it’s different from the page you see if you click the “shop for a cause” tab.
      -The calendar items go below the blue shading for the calendar and look a little awkward.
      -On the Community Partners page Kaiser was grey before I clicked on the link.
      -There are tabs underneath the Search box at the top right of each screen.
      -It would be nice to have an e-mail us option on the Contact Us page.
      -The mission seems to be scrunched up right next to the tabs…I think it’d be nice to have a little open space between the tabs and the mission so it stands out better.
      -It seems awkward to have phone abbreviated since it’s such as short word and nothing else on the footer is abbreviated.
    5. An improvement over the old one. Thanks!

Results summary

Overall it seems that the testers agreed that the new Face to Face site is an improvement upon the old version. Specific results varied though. For instance, some testers loved the slideshow, while others found it cumbersome. And some testers found the navigation and the redundant links very logical and helpful while others found it confusing. But as I said, everyone agreed that it was an improvement. And given that in life you cannot please everyone, I would assume this project a success.

Changes to be implemented

Many of the content specific changes (typos, etc.) and simple layout changes have already occurred. We are having a meeting this week with Face to Face to discuss other more intensive changes and determine whether, given the time remaining in the semster and the extent of the changes, we can complete them. Face to Face has expressed concerns regarding the main navigation size and functionality as well as a potentially significant change to the Art for Life Gallery. As noted above, we do not have details on these concerns and will have more information later this week.