How to Run a Free Survey Experiment Pilot
Pilot a randomized survey experiment free with text, image, or video conditions and up to 20 completed responses.
The Short Version
Pilot a randomized survey experiment free with text, image, or video conditions and up to 20 completed responses. A practical way to begin is to build the treatment conditions and select the first condition as the reference, then add the primary outcome after treatment exposure. Finish by making sure you fix comprehension or routing problems before buying a larger sample. The full walkthrough below explains each part in order.
Is This Guide for You?
Researchers and teams validating treatment wording, routing, outcome questions, and results before paid fielding.
Follow These Steps
Work through these 6 steps at your own pace. The wording is intentionally practical, and you can return to the checklist at the end when you are ready to review your work.
- Build the treatment conditions and select the first condition as the reference.
- Add the primary outcome after treatment exposure.
- Preview every treatment path.
- Publish the pilot and collect a small set of test responses.
- Inspect treatment means, mean differences, confidence intervals, and the effect graph.
- Fix comprehension or routing problems before buying a larger sample.
What This Helps You Accomplish
A pilot tests whether randomization, stimuli, questions, and analysis work together. The free plan currently permits one survey and up to 20 completed responses for this purpose.
A Quick Confidence Check
- Preview every arm.
- Check media loading.
- Verify outcome coding.
- Inspect the graph.
- Use a larger planned sample for final inference.
Common Questions
Can I use this guide if I am new to this?
Yes. Researchers and teams validating treatment wording, routing, outcome questions, and results before paid fielding. Follow the steps in order, start with a small test, and use the final checklist before you field or report anything important.
What is the simplest way to get started?
Begin by build the treatment conditions and select the first condition as the reference. Next, add the primary outcome after treatment exposure. You do not need to perfect every setting before running a small preview or pilot.
How do I know when I am ready?
Use the confidence check above. In particular: Preview every arm. Check media loading. Verify outcome coding. Inspect the graph. When the decision is consequential, keep your study documentation and ask a qualified colleague or methods reviewer to examine the design as well.
Related Guides
Research artifact: sample data, codebook, and scriptsResearch Pathways
Product names and fielding platforms mentioned in this guide belong to their respective owners. Conjoint Survey is an independent academic research tool and is not affiliated with, sponsored by, or endorsed by those services.