How to Use Attention Checks
Add comprehension or attention checks without turning the survey into a trap.
The Short Version
Add comprehension or attention checks without turning the survey into a trap. A practical way to begin is to add a clear attention or recall question, then place it after the relevant stimulus when it checks comprehension. Finish by making sure you report failures in the fielding summary. The full walkthrough below explains each part in order.
Is This Guide for You?
Researchers concerned about inattentive respondents.
Follow These Steps
Work through these 4 steps at your own pace. The wording is intentionally practical, and you can return to the checklist at the end when you are ready to review your work.
- Add a clear attention or recall question.
- Place it after the relevant stimulus when it checks comprehension.
- Set exclusion rules before final analysis.
- Report failures in the fielding summary.
What This Helps You Accomplish
Attention checks can improve data quality, but they should be fair, relevant, and documented.
A Quick Confidence Check
- Avoid trick questions.
- Use recall checks for treatments.
- Do not hide exclusion rules.
Common Questions
Can I use this guide if I am new to this?
Yes. Researchers concerned about inattentive respondents. Follow the steps in order, start with a small test, and use the final checklist before you field or report anything important.
What is the simplest way to get started?
Begin by add a clear attention or recall question. Next, place it after the relevant stimulus when it checks comprehension. You do not need to perfect every setting before running a small preview or pilot.
How do I know when I am ready?
Use the confidence check above. In particular: Avoid trick questions. Use recall checks for treatments. Do not hide exclusion rules. When the decision is consequential, keep your study documentation and ask a qualified colleague or methods reviewer to examine the design as well.
Related Guides
Research artifact: sample data, codebook, and scriptsResearch Pathways
Product names and fielding platforms mentioned in this guide belong to their respective owners. Conjoint Survey is an independent academic research tool and is not affiliated with, sponsored by, or endorsed by those services.