Skip to main content

Lessons from Early Rounds of Usability Testing

My last post about usability testing talked about set up and guidelines for testing. Following up, here are some outcomes and lessons from a couple testing sessions so far:
  • You can get great feedback. It’d be great to build a product leveraging the experience of the founders in a startup and customers use the product seamlessly. However, founders’ view of the world can be skewed. Usability testing solicits feedback directly from the target audience.
  • Find users who will provide candid feedback. Operative words are “provide” and “candid”. Usability testing can be awkward for testers not used to giving honest feedback. It’s important for the company and customers that users provide critical feedback knowing no answer is wrong – benefits go around for everyone.
  • Bugs can screw it all up. The goal of usability testing is to assess how users interact with the product. Sometimes, you’ll want users to perform specific tasks. However, product bugs can quickly halt testing; thus, preventing constructive feedback. Now, feedback may focus on bugs rather than usability.
  • Early testing can tell you everything. Stop. Iterate. Continue later. That is, early users may find resounding issues during tests. You’ll know it when it happens. In this case, discontinue testing till these headaches are resolved else you get the same feedback from all users. Go again.
  • Watch for unspoken signs. In presentations and demos, I scan faces in the room for emotions and reactions. In usability testing, I do the same. Do they seem delighted or uninterested? Is the user focused? Confused? What’s left unsaid can be most telling.
Usability testing has been a great process for us so far. We identified key gaps, and emerged focusing efforts on select features while reducing clutter. Before, we hypothesized what users wanted. Testing has provided real data and insight.

What outcomes or lessons have you learned from usability testing as a test-giver? Any input as a test-taker? How has usability testing helped your company’s product development and roadmap?

Comments

Popular posts from this blog

Vertical SaaS? Horizontal SaaS? It’s All News to Me

Not sure why, but I have only recently heard of a term called “Vertical SaaS”. Okay, there’s also “Horizontal SaaS”, too. Based on some light research, looks like vertical SaaS is also a growing trend and the number of companies fewer than horizontal SaaS providers.
Vertical SaaS borrows its moniker from the concept of vertical integration whereby there is more control over a supply chain from raw materials to point-of-sale. Here, vertical SaaS companies focus on a niche market (industry) offering a solution that enables more process control.
Horizontal SaaS providers get really good at a particular offering, and widen their market to reach scale. Their focus is on breadth of market, and thus, its sales and marketing strategies can require more resources.
Many vertical SaaS companies (such as Veeva Systems, Guidewire, Fleetmatics) are doing well usurping legacy systems of traditionally slow-tech-adoption industries. Here, vertical companies develop a best-of-breed product, and focu…

My Life-Defining Moment Happened When I Failed to Make Varsity in High School

Ever stop to think about who you are? What makes you tick and tock? How about what you truly enjoy and what you’re good at vs. not good at? Or what/ who has shaped you into the person you are today?
I’m at this stage of figuring out whether to continue independent consulting while iterating on ideas for the next startup or take on some full-time employment (consulting, product management, or otherwise). My recent post about my daily/ weekly schedule was an interesting exercise in stepping back and recognizing what I’m actually doing in a day, and made me really think at the macro level.
In one of my recent reflections, I thought about defining moments in my life. One of those watershed events that truly transformed me was my failure to make the Varsity soccer team in high school. I won’t rehash the whole story here – shared the story almost a year ago in my post titled “Getting Through Dark Moments and the Most Vulnerable Story I've Ever Told Publicly”. It’s this moment that I w…

De-Risk for Investments

I was talking to a Producer and Director recently who is starting out his business. He’s got his business set up, and is seeking investors for a film. He’s got the script. He’s ready to go. Except, the investors want him to slow down. The investors wanted to “de-risk” the investment. New to being an entrepreneur, the Producer shared the nuances he wasn’t quite prepared for. Expected ReturnsSaaStr states that a 10% return on the total venture capital (VC) fund is good while aiming to earn its total VC fund in profits is the goal. Understand what the goals of the investor(s) are, and have the model to illustrate goals can be met with even conservative achievement.Legal Collateral – The Producer was shocked to learn how much he had to spend to validate the authenticity and originality of the script. Investors are looking at legal terms and insurance to not only cover risks of copyright infringement, but also the leveragability for greater valuation.Long-Term Strategy – Are you a one-h…