How to Run a Randomization Audit
Check whether randomized attributes and levels are appearing as expected.
The Short Version
Check whether randomized attributes and levels are appearing as expected. A practical way to begin is to open Design Review or Audit, then run the simulated exposure check. Finish by making sure you export the audit for records. The full walkthrough below explains each part in order.
Is This Guide for You?
Researchers verifying design behavior before or after fielding.
Follow These Steps
Work through these 5 steps at your own pace. The wording is intentionally practical, and you can return to the checklist at the end when you are ready to review your work.
- Open Design Review or Audit.
- Run the simulated exposure check.
- Review counts, expected counts, and ratios.
- After fielding, inspect actual conjoint exposure balance.
- Export the audit for records.
What This Helps You Accomplish
Randomization audits catch design problems before they become reviewer problems.
A Quick Confidence Check
- Check after adding restrictions.
- Check actual fielded exposure too.
- Include audit output in appendix when useful.
Common Questions
Can I use this guide if I am new to this?
Yes. Researchers verifying design behavior before or after fielding. Follow the steps in order, start with a small test, and use the final checklist before you field or report anything important.
What is the simplest way to get started?
Begin by open Design Review or Audit. Next, run the simulated exposure check. You do not need to perfect every setting before running a small preview or pilot.
How do I know when I am ready?
Use the confidence check above. In particular: Check after adding restrictions. Check actual fielded exposure too. Include audit output in appendix when useful. When the decision is consequential, keep your study documentation and ask a qualified colleague or methods reviewer to examine the design as well.
Related Guides
Research artifact: sample data, codebook, and scriptsResearch Pathways
Product names and fielding platforms mentioned in this guide belong to their respective owners. Conjoint Survey is an independent academic research tool and is not affiliated with, sponsored by, or endorsed by those services.