Experiment & Research Method
Preference Test
A preference test shows people two or more options and asks which they prefer and why.
- Fidelity
- Low
- Effort
- Low
- Time to run
- 3–7 days
What is a Preference Test?
A preference test presents participants with two or more design options — layouts, visuals, messages — and asks which they prefer, ideally with a follow-up on why. It is a fast, low-cost way to get directional feedback on subjective choices before committing to build, especially for visual and copy decisions where opinion strongly shapes response.
The crucial caveat: preference is stated opinion, not behavior. A preferred option should still be validated with a live A/B test when the decision carries real weight.
When to use it
Good fit
- You are choosing between visual designs, messages, or concepts.
- You want quick, early direction before investing in development.
- Capturing the reasons behind a preference will guide the broader design.
Reach for something else when
- The decision is high-stakes and needs proof of real behavior (use an A/B test).
- You are testing whether users can complete a task (use usability testing).
- Options differ in ways users cannot fairly judge from a static comparison.
How to run it
Prepare comparable options
Create options that differ on the variable you care about while holding other factors constant, so the comparison is fair.
Frame a neutral question
Ask which option people prefer for a specific goal, avoiding wording that hints at a "right" answer.
Recruit representative respondents
Reach enough of the right people that the winning margin can be distinguished from chance.
Ask why, not just which
Capture the reasoning behind each choice so you can extract a transferable principle, not a one-off winner.
Validate the winner when it matters
For consequential decisions, confirm the preferred option with a live A/B test measuring actual behavior.
What you'll learn
Which option people prefer and, more importantly, the reasons why — fast directional input for subjective design and messaging decisions.
Frequently asked questions
Does a preference test predict real behavior?
Only loosely. Preference tests capture stated opinion, which correlates with but does not equal behavior. They are ideal for cheap, early direction on subjective choices, but high-stakes decisions should be confirmed with a live A/B test that measures what users actually do.
Why ask "why" in a preference test?
Knowing which option won is far less useful than knowing why. The reasons reveal the underlying principle — clarity, trust, tone — that you can apply beyond the specific options tested, turning a one-off result into a durable design insight.