Skip to main content

Product Ready? Product Set? Usability Test Go!

I’m helping run usability tests with a startup; though, I have not formally “run” one in the past. It’s been a great learning experience.

The company’s launching a new site in education, and with the product having been in development for a few months, it’s ready for users to test. For us, we’re soliciting feedback on user experience, shaping our product roadmap, and testing marketing messaging.

I’ve uploaded a Usability Testing Guidelines template I created leveraging others I’ve found with adjustments here: Usability Testing Guidelines. I’ve removed some specific portions, but left in others for illustrative purposes. You’ll want to adjust as you see fit.

(Note: I use “site” here, but substitute the product/ service you’re testing.)

Here are the key components of the Guidelines:
  • Testing – Observer Guidelines. General instructions for the observer when moderating tests.
  • Agenda and Set-Up. Establish the logistics for testing. Ensure the location is ready, devices are set up, and have back-up plans in case things don’t go as planned.
  • Testing Script. Set the guidelines between tester and test-taker including language to encourage honest, impulsive feedback.
  • Usability Tasks. Ensure specific elements of the site are tested. Tasks help navigate testing along timeline.
  • Closing Questions. When in front of target users, it’s advantageous to ask specific and open questions as time allows. These questions help determine the product roadmap, key in on marketing messaging, identify trouble areas not identified before, etc.
Additionally, I like a hybrid approach to testing – unstructured at the beginning, then structured with tasks. With an unstructured format, users go about a site detailing thoughts and driving their interaction as s/he desires. In a structured format, the tester helps navigate the user via tasks and questions.

What lessons do you have from usability tests as a tester or test-taker? How have usability tests been poorly run? Effectively run?

Comments

Popular posts from this blog

Vertical SaaS? Horizontal SaaS? It’s All News to Me

Not sure why, but I have only recently heard of a term called “Vertical SaaS”. Okay, there’s also “Horizontal SaaS”, too. Based on some light research, looks like vertical SaaS is also a growing trend and the number of companies fewer than horizontal SaaS providers.
Vertical SaaS borrows its moniker from the concept of vertical integration whereby there is more control over a supply chain from raw materials to point-of-sale. Here, vertical SaaS companies focus on a niche market (industry) offering a solution that enables more process control.
Horizontal SaaS providers get really good at a particular offering, and widen their market to reach scale. Their focus is on breadth of market, and thus, its sales and marketing strategies can require more resources.
Many vertical SaaS companies (such as Veeva Systems, Guidewire, Fleetmatics) are doing well usurping legacy systems of traditionally slow-tech-adoption industries. Here, vertical companies develop a best-of-breed product, and focu…

My Life-Defining Moment Happened When I Failed to Make Varsity in High School

Ever stop to think about who you are? What makes you tick and tock? How about what you truly enjoy and what you’re good at vs. not good at? Or what/ who has shaped you into the person you are today?
I’m at this stage of figuring out whether to continue independent consulting while iterating on ideas for the next startup or take on some full-time employment (consulting, product management, or otherwise). My recent post about my daily/ weekly schedule was an interesting exercise in stepping back and recognizing what I’m actually doing in a day, and made me really think at the macro level.
In one of my recent reflections, I thought about defining moments in my life. One of those watershed events that truly transformed me was my failure to make the Varsity soccer team in high school. I won’t rehash the whole story here – shared the story almost a year ago in my post titled “Getting Through Dark Moments and the Most Vulnerable Story I've Ever Told Publicly”. It’s this moment that I w…

Role of A Startup Advisor

Over the last year or so, I have become an Advisor for a couple startups. It’s been a great experience for me to teach and continue learning as an entrepreneur. I do meet with several startups and entrepreneurs weekly, but not officially as an Advisor save for a couple.
During (and especially after) Body Boss, I realized the importance of having Advisors. Advisors help startups and the executive team navigate the go-to-market waters bringing specific experience to the table – industry, technology, etc. With that comes connections, too.
The role of a startup Advisor includes: Guiding the startup on its directionProvide valuable insight into the industry, competition, market, etc.Share connections to move the company forward – prospects, new hire candidates, otherEstablish cadence around metrics for progress In exchange for devoting time and attention (and reaching success, hopefully), startups typically provide stock or cash to Advisors. This ensures both parties are aligned on objecti…