CSConjoint Survey

How to Evaluate Vendor Selection Criteria

Structure stakeholder tradeoffs among vendor capabilities before issuing or scoring a selection process.

The Short Version

Structure stakeholder tradeoffs among vendor capabilities before issuing or scoring a selection process. A practical way to begin is to define the purchasing decision and nonnegotiable requirements, then convert discretionary criteria into clear levels. Finish by making sure you run sensitivity checks to see whether small weight changes alter the decision. The full walkthrough below explains each part in order.

Is This Guide for You?

Procurement, IT, operations, and program teams aligning on evaluation priorities.

Follow These Steps

Work through these 6 steps at your own pace. The wording is intentionally practical, and you can return to the checklist at the end when you are ready to review your work.

  1. Define the purchasing decision and nonnegotiable requirements.
  2. Convert discretionary criteria into clear levels.
  3. Use conjoint or structured tradeoff questions with relevant stakeholders.
  4. Separate preference weights from security, legal, and compliance gates.
  5. Document the final scoring rule before reviewing bids.
  6. Run sensitivity checks to see whether small weight changes alter the decision.

What This Helps You Accomplish

Explicit tradeoffs reduce post-hoc weighting designed to favor a preferred vendor, while mandatory risk controls remain separate from preference.

A Quick Confidence Check

  • Set hard requirements first.
  • Use clear criteria.
  • Include affected teams.
  • Predefine scoring.
  • Document conflicts of interest.
  • Run sensitivity checks.

Common Questions

Can I use this guide if I am new to this?

Yes. Procurement, IT, operations, and program teams aligning on evaluation priorities. Follow the steps in order, start with a small test, and use the final checklist before you field or report anything important.

What is the simplest way to get started?

Begin by define the purchasing decision and nonnegotiable requirements. Next, convert discretionary criteria into clear levels. You do not need to perfect every setting before running a small preview or pilot.

How do I know when I am ready?

Use the confidence check above. In particular: Set hard requirements first. Use clear criteria. Include affected teams. Predefine scoring. When the decision is consequential, keep your study documentation and ask a qualified colleague or methods reviewer to examine the design as well.

Related Guides

Research artifact: sample data, codebook, and scripts

Research Pathways

Product names and fielding platforms mentioned in this guide belong to their respective owners. Conjoint Survey is an independent academic research tool and is not affiliated with, sponsored by, or endorsed by those services.