Opportunity
Our client, a cloud-based spreadsheet and reporting tool, wanted to test concepts for their toolkit ahead of the next development cycle.
For this study, our client wanted to understand whether their product updates were intuitive and easy to use, and whether participants could see a use for these tools in their current workflow.
We recruited participants to do a first-round concept testing study, paused for the client to update their concepts based on feedback, and then ran a second round with some of those same participants to understand the efficacy of the updates.
Role
Solutions Lead
Lead Researcher
Team Members
N/A
Methods
Discovery Interviews
Concept Testing
Primary Objectives
-
Understand the efficacy and usability of the client’s new tool designs
-
Identify the efficacy of and gaps in the onboarding experience
-
Understand the value of the product to users who routinely create and distribute reports
Deliverables
-
A punch list of prioritized findings and actionable recommendations following first round interviews
-
A report with new findings, refined recommendations, and directions for development following second-round interviews
Approach
-
Work with the client to understand goals and distill tasks into a moderator’s guide
-
Run 12 first-round, 75-minute sessions with intermediate spreadsheet users who create reports on a regular basis
-
Create a report of quick-glance, prioritized findings and recommendations for immediate changes to the test stimuli
-
Run four second-round, 45-minute sessions with participants from the first round to evaluate the efficacy of the changes made and gather feedback on larger thematic findings
-
Deliver a final report that included user context, thematic findings, and detailed, prioritized findings and recommendations
Client Impact
-
Actionable, immediate steps for improvements to the online tool
-
Evaluation of the impact of the recommended changes from the first round
-
Short- and long-term recommendations for tool, onboarding, and overall website development
-
Refined understanding of the client’s true target audience, for use in development efforts and future testing
-
Recommended directions for future experience research