Posts Tagged ‘remote user testing’

Project Profile: BECU (Boeing Employees’) Credit Union

Friday, July 23rd, 2010

We often sneak a quick look at the projects our members are running and we came across this beauty by the clever guys at the interactive agency ZAAZ, who did some re-design work on the BECU (Boeing Employee’s Credit Union) website (www.becu.org).

Their project was designed to give them the answer to just one question, “What do we call the place where our website visitors go to do their…you know…thingamybob banking that you do when you don’t do it at one of the BECU Neighborhood Financial Centers?”

A very simple project was constructed to get them precisely that one answer. Here’s what they did…

Five different hi-fidelity wireframe designs of the BECU homepage were created and hosted on a staging server. Three designs were identical except for the label to this unnamed section of the website. One placed the link in the primary navigation, rather than the utility navigation at the top, and the final design placed the link in the footer.

The alternative labels for the section were:

  • Remote Account
  • Access Mobile & Online Banking
  • Remote Banking, and
  • Online Banking (for the one in the footer)

Five separate projects were set up so there was no task order bias and the task was worded the same way for each project:

“Use the site to find how to view your banking information using your internet-enabled cell phone.”

During the evalution, when participants selected a link that did not direct them to the ‘correct’ location they were presented with the screen below, which is particularly handy as navigating through a wireframed website where only the home page had any functional purpose could have been disasterously confusing for participants.

Four follow-up questions were asked, again always the same for each project.  They were:

  1. How difficult was it to complete this task?
  2. How certain did you feel that the “[Name of the section]” link would take you to the information you were looking for?
  3. What specific information would you expect to see when you click on ” Name of the section”?
  4. What, if anything, would be a better name or label for this information?

All in all a quick, simple and inexpensive way of getting a precise link label to a section of their website growing in importance.

As for the results of the testing…well, go to www.becu.org to find out which option provided the best experience.

Loop11 Updates: Track participants, Re-categorise multiple URLs, Pop-up invitation control, Improved reporting and more

Tuesday, June 22nd, 2010

It’s been a while since we posted an update about Loop11, but we’ve just launched some new features, and we wanted to let you know about them.

Apart from the many minor (oh, alright…and a couple of major) bug fixes we made recently, we’ve also improved the performance of our servers so page load speeds should be faster.

The other key changes include:

Track participants using unique IDs

If you want to track participants so you know who to provide incentives to you can customise the end of the URL with a unique ID for each participant. You can find this new feature in Step 3 – User Test Options and full details of the process here.

Re-Categorise multiple URLs at a time

Instead of re-categorising one URL at a time you can now re-categorise multiple URLs at the same time. You can find this new feature in the reporting of any task.

Pop-up invitation controls

If you are recruiting your participants by intercepting them via your website, you now have a feature allowing you to control the percentage of visitors that you ‘invite’. You can find this new feature in Step 4 – Invite Participants: Create a pop-up invitation for your own website.

Individual participant path analysis in exports

The full path analysis of individual participants was never made available in the exported reports. Don’t ask why. But it is there now.

Individual responses for Rating Scale Matrix questions

The results for rating scale matrix questions, while always available at an aggregated level were never available so you could see the individual participant responses. These can now be found in your reporting under Participants.

Most of these changes have come about from customer feedback. Just give us your opinion and we will happily take it on board!

Happy Testing!

PS: The guys at UserFirst have elaborated on these features on their blog. The post is located here: http://www.userfirst.com/our-blog/2010/06/28/unmoderated-usability-study/