Skip to main content

Lessons from Early Rounds of Usability Testing

My last post about usability testing talked about set up and guidelines for testing. Following up, here are some outcomes and lessons from a couple testing sessions so far:
  • You can get great feedback. It’d be great to build a product leveraging the experience of the founders in a startup and customers use the product seamlessly. However, founders’ view of the world can be skewed. Usability testing solicits feedback directly from the target audience.
  • Find users who will provide candid feedback. Operative words are “provide” and “candid”. Usability testing can be awkward for testers not used to giving honest feedback. It’s important for the company and customers that users provide critical feedback knowing no answer is wrong – benefits go around for everyone.
  • Bugs can screw it all up. The goal of usability testing is to assess how users interact with the product. Sometimes, you’ll want users to perform specific tasks. However, product bugs can quickly halt testing; thus, preventing constructive feedback. Now, feedback may focus on bugs rather than usability.
  • Early testing can tell you everything. Stop. Iterate. Continue later. That is, early users may find resounding issues during tests. You’ll know it when it happens. In this case, discontinue testing till these headaches are resolved else you get the same feedback from all users. Go again.
  • Watch for unspoken signs. In presentations and demos, I scan faces in the room for emotions and reactions. In usability testing, I do the same. Do they seem delighted or uninterested? Is the user focused? Confused? What’s left unsaid can be most telling.
Usability testing has been a great process for us so far. We identified key gaps, and emerged focusing efforts on select features while reducing clutter. Before, we hypothesized what users wanted. Testing has provided real data and insight.

What outcomes or lessons have you learned from usability testing as a test-giver? Any input as a test-taker? How has usability testing helped your company’s product development and roadmap?

Comments

Popular posts from this blog

You Make Time for What (and Who) Matters

I’ve always been a big proponent that you make time for the things and people that matter. Sounds simple, right? Then, why do so many not implement this better in their lives? Let me take a moment to recognize this more explicitly.
I touched on Laura Vanderkam’s TED Talk “How to Gain Control of Your Free Time” in last week’s post. In it, she shares a story of a woman who had a leak in her home. Coordinating with plumbers, and getting everything resolved, the woman estimated that it probably took seven hours of attention. That’s seven hours of “stuff” the woman hadn’t planned on doing. If you were to ask her (or most anyone) to find seven hours in the week before, she’d have told you, “heck, no, I don’t have seven hours. I’m busy!”
I was thinking of Laura’s talk in conjunction with Jacob Christensen’s How Will You Measure Your Life. Specifically, I’m aligning “making time” with Christensen’s Resources-Processes-Priorities framework. We make (process) time (resources) for the things th…

Vertical SaaS? Horizontal SaaS? It’s All News to Me

Not sure why, but I have only recently heard of a term called “Vertical SaaS”. Okay, there’s also “Horizontal SaaS”, too. Based on some light research, looks like vertical SaaS is also a growing trend and the number of companies fewer than horizontal SaaS providers.
Vertical SaaS borrows its moniker from the concept of vertical integration whereby there is more control over a supply chain from raw materials to point-of-sale. Here, vertical SaaS companies focus on a niche market (industry) offering a solution that enables more process control.
Horizontal SaaS providers get really good at a particular offering, and widen their market to reach scale. Their focus is on breadth of market, and thus, its sales and marketing strategies can require more resources.
Many vertical SaaS companies (such as Veeva Systems, Guidewire, Fleetmatics) are doing well usurping legacy systems of traditionally slow-tech-adoption industries. Here, vertical companies develop a best-of-breed product, and focu…

My Life-Defining Moment Happened When I Failed to Make Varsity in High School

Ever stop to think about who you are? What makes you tick and tock? How about what you truly enjoy and what you’re good at vs. not good at? Or what/ who has shaped you into the person you are today?
I’m at this stage of figuring out whether to continue independent consulting while iterating on ideas for the next startup or take on some full-time employment (consulting, product management, or otherwise). My recent post about my daily/ weekly schedule was an interesting exercise in stepping back and recognizing what I’m actually doing in a day, and made me really think at the macro level.
In one of my recent reflections, I thought about defining moments in my life. One of those watershed events that truly transformed me was my failure to make the Varsity soccer team in high school. I won’t rehash the whole story here – shared the story almost a year ago in my post titled “Getting Through Dark Moments and the Most Vulnerable Story I've Ever Told Publicly”. It’s this moment that I w…