By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
SmartData Collective
  • Analytics
    AnalyticsShow More
    predictive analytics in dropshipping
    Predictive Analytics Helps New Dropshipping Businesses Thrive
    12 Min Read
    data-driven approach in healthcare
    The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas
    6 Min Read
    analytics for tax compliance
    Analytics Changes the Calculus of Business Tax Compliance
    8 Min Read
    big data analytics in gaming
    The Role of Big Data Analytics in Gaming
    10 Min Read
    analyst,women,looking,at,kpi,data,on,computer,screen
    Promising Benefits of Predictive Analytics in Asset Management
    11 Min Read
  • Big Data
  • BI
  • Exclusive
  • IT
  • Marketing
  • Software
Search
© 2008-23 SmartData Collective. All Rights Reserved.
Reading: Low-Cost Usability Testing: Why and How
Share
Notification Show More
Latest News
ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
ai in omnichannel marketing
AI is Driving Huge Changes in Omnichannel Marketing
Artificial Intelligence
ai for small business tax planning
Maximize Tax Deductions as a Business Owner with AI
Artificial Intelligence
ai in marketing with 3D rendering
Marketers Use AI to Take Advantage of 3D Rendering
Artificial Intelligence
How Big Data Is Transforming the Maritime Industry
How Big Data Is Transforming the Maritime Industry
Big Data
Aa
SmartData Collective
Aa
Search
  • About
  • Help
  • Privacy
Follow US
© 2008-23 SmartData Collective. All Rights Reserved.
SmartData Collective > Business Intelligence > CRM > Low-Cost Usability Testing: Why and How
Business IntelligenceCRMMarket ResearchMarketingWeb Analytics

Low-Cost Usability Testing: Why and How

ariherzog
Last updated: 2013/03/08 at 5:30 AM
ariherzog
9 Min Read
SHARE

usability testing for website

Contents
Why Do ItHow To Do A Low-Cost Usability TestWhat Could Be

usability testing for website

This is a guest blog post by Laura Orban.

Usability testing should be part of what every website owner does on a regular basis. In my experience, few actually do it. Or if we do it, it’s only done a week before a major redesign launches.

Part of why we don’t usability test is because of what we think it has to be. We imagine an all-out usability lab complete with a one-way mirror with 10 people sitting behind it. We imagine thousands, or even tens of thousands of dollars being spent.

More Read

data-driven approach in healthcare

The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas

Automotive Industry Uses Analytics To Solve Pressing Supply Chain Issues
How can CIOs Build Business Value with Business Analytics?
Seven Benefits of Using AI to Perform Text Analysis
7 Data Lineage Tool Tips For Preventing Human Error in Data Processing

Test, test, test!

If you’re responsible for the software that lands airplanes or that heart surgeons use, by all means, do that. If you are one of the millions of websites on which people’s lives don’t depend, you can try the low-cost way.

We should all be testing. Businesses large and small, non-profits, even municipalities and public schools should test.

Why Do It

We can (and should) test our websites early and often. One of the most common objections to low-cost usability testing is that it’s not going to yield quality results. That’s not true. Subscribers to that belief don’t tend to do the expensive kind, they tend to do nothing.

Getting some feedback is always better than getting none.

Usability testing expert Jakob Nielsen tells us that low cost testing done iteratively is better than doing nothing and can actually yield very good results.

Testing with just 5 users will find 85% of the problems. While you may need 15 to find all the problems, it is better to test with 5 on 3 different occasions than it is to do one test with all 15 and stop.

How To Do A Low-Cost Usability Test

We’ll go through each of these steps, one at a time:

  • gather your stakeholders
  • document the goals of testing
  • create test questions/scenarios
  • find your participants
  • conduct the test
  • review results and decide what to fix

1. Gather your stakeholders

It’s important to get the people who are invested in the project involved early. You don’t need every person, but you should have a representative from the critical areas like: leadership, user experience, operations, development, content authoring, metrics and your business owners.

You don’t want to be surprised right before the test because someone who needed a say in the plan didn’t know it was happening.

2. Document the goals of testing

You need to document your goals. What do you hope to learn? Is there a new feature you want to test? Are you comparing 2 designs? Do you want to know why users aren’t completing a critical task?

If your site is live, you should look at what your metrics are telling you at this step. Web analytics can tell you what users are doing, usability testing can tell you why. Use your metrics as input to your test goals.

3. Create the test questions

The goals of testing inform the test questions and scenarios. They are not the same.

The test questions are the things your team wants to have answered. But you aren’t going to sit someone down in front of a computer and ask them to tell you outright if, say, your categories make sense. You are going to give them a task which will allow you to see if the categories are making sense.

Your test questions and scenarios will consist of the things you want the user to do (maybe complete your sites most important tasks) the results of which will yield answers to your test questions.

4. Find your participants

This is where the expense may come in. You will probably have to compensate participants for their time. It shows that you respect and appreciate their input.

This is compensation for their time and not compensation for specific feedback.

Renowned author and low cost usability testing expert Steve Krug tells us that when it comes to finding participants, “recruit loosely and grade on a curve.”

That means that for the sake of speed and money, you’ll do just fine by selecting 3-5 participants who are as close to your typical user as possible, even if they are not an exact match. Just keep that in mind when reviewing the results.

5. Conduct the test

Your set-up is relatively simple. You need a computer, 2 chairs and either a video camera or software that will capture your screen. It will be just you and the participant in the room. The video or screen capture (which must record your voices) will be used to show others the results. You don’t have to take as many notes when you have it recorded.

Steve Krug offers an excellent script you can follow. You want to make sure you hit the following points:

  • let the participant know they’ll be recorded and get a release signed
  • tell the participant that you are testing the website, not them
  • let the participant know that you want honest feedback
  • make sure the participant knows that s/he can stop the test at any time for any reason

It’s important to make the participant feel comfortable and to respect their rights.

Start off with a few casual questions: what they do for a living, how much time they spend online, favorite websites, etc. This will help him/her to relax, and also possibly give you some insight into what they’re like.

Tell them their task. Make sure their starting page is ready to open. Ask them to think out loud. This is critical. Your job is to learn why they are doing what they’re doing. You may have to prompt them (“why did you click on that link?” or “what were you expecting to find here?”).

6. Review the results

This is the last step. You and your stakeholders will review the results together. You’ll decide what you’ll try to fix based on what you saw. There is no 20 page report. There is a 1 to 2 page write-up documenting what you saw and what you’re going to do about it.

Steve Krug recommends picking one morning a month for user testing. Test 3 participants in a row, and have lunch as a team to review and decide what to fix. It’s that simple.

What Could Be

We’ve all had the experience of using a website that is so bad, we can’t imagine the people who own it have ever tried to use it. But it’s easy to use our own stuff. We need an outside person to show us why the terminology we know doesn’t make sense to the average user.

Testing early is important. Draw your design on a piece of paper and test that before you spend hours coding.

What did I forget? What questions can I answer?

***
Laura Orban is an internet marketer, movie quoter, mom, lover of big rescue dogs, wife, compulsive volunteer, problem solver, and happy. Visit her blog at LauraOrban.com and tweet her at @LauraOrban.

TAGGED: analytics, metrics, usability testing
ariherzog March 8, 2013
Share this Article
Facebook Twitter Pinterest LinkedIn
Share

Follow us on Facebook

Latest News

ai software development
Key Strategies to Develop AI Software Cost-Effectively
Artificial Intelligence
ai in omnichannel marketing
AI is Driving Huge Changes in Omnichannel Marketing
Artificial Intelligence
ai for small business tax planning
Maximize Tax Deductions as a Business Owner with AI
Artificial Intelligence
ai in marketing with 3D rendering
Marketers Use AI to Take Advantage of 3D Rendering
Artificial Intelligence

Stay Connected

1.2k Followers Like
33.7k Followers Follow
222 Followers Pin

You Might also Like

data-driven approach in healthcare
Analytics

The Importance of Data-Driven Approaches to Improving Healthcare in Rural Areas

6 Min Read
supply chain analytics
Analytics

Automotive Industry Uses Analytics To Solve Pressing Supply Chain Issues

6 Min Read
Analytics

How can CIOs Build Business Value with Business Analytics?

8 Min Read
text analytics
Text Analytics

Seven Benefits of Using AI to Perform Text Analysis

9 Min Read

SmartData Collective is one of the largest & trusted community covering technical content about Big Data, BI, Cloud, Analytics, Artificial Intelligence, IoT & more.

AI chatbots
AI Chatbots Can Help Retailers Convert Live Broadcast Viewers into Sales!
Chatbots
giveaway chatbots
How To Get An Award Winning Giveaway Bot
Big Data Chatbots Exclusive

Quick Link

  • About
  • Contact
  • Privacy
Follow US

© 2008-23 SmartData Collective. All Rights Reserved.

Removed from reading list

Undo
Go to mobile version
Welcome Back!

Sign in to your account

Lost your password?