How to Monitor Fielding Quality
Watch completion rates, timing, duplicates, attention checks, and response patterns during data collection.
The Short Version
Watch completion rates, timing, duplicates, attention checks, and response patterns during data collection. A practical way to begin is to check response counts soon after launch, then review median completion time. Finish by making sure you pause fielding if a technical issue appears. The full walkthrough below explains each part in order.
Is This Guide for You?
Researchers collecting live responses from panels, classes, mailing lists, or public recruitment.
Follow These Steps
Work through these 6 steps at your own pace. The wording is intentionally practical, and you can return to the checklist at the end when you are ready to review your work.
- Check response counts soon after launch.
- Review median completion time.
- Inspect incomplete starts and duplicate IDs.
- Check attention or recall check rates.
- Confirm profile exposure looks reasonable.
- Pause fielding if a technical issue appears.
What This Helps You Accomplish
Early monitoring catches problems while they can still be fixed. Waiting until the full sample is complete can make mistakes expensive.
A Quick Confidence Check
- Monitor early completes.
- Check IDs and timing.
- Review attention checks.
- Pause if routing is wrong.
Common Questions
Can I use this guide if I am new to this?
Yes. Researchers collecting live responses from panels, classes, mailing lists, or public recruitment. Follow the steps in order, start with a small test, and use the final checklist before you field or report anything important.
What is the simplest way to get started?
Begin by check response counts soon after launch. Next, review median completion time. You do not need to perfect every setting before running a small preview or pilot.
How do I know when I am ready?
Use the confidence check above. In particular: Monitor early completes. Check IDs and timing. Review attention checks. Pause if routing is wrong. When the decision is consequential, keep your study documentation and ask a qualified colleague or methods reviewer to examine the design as well.
Related Guides
Research artifact: sample data, codebook, and scriptsResearch Pathways
Product names and fielding platforms mentioned in this guide belong to their respective owners. Conjoint Survey is an independent academic research tool and is not affiliated with, sponsored by, or endorsed by those services.