← Back to the library
Research and business strategy

Vendor evaluation

Compare supplied vendors against pass/fail requirements and user priorities with explicit unknowns and tradeoffs.

Works with the context you provideVersion 1.0.1Historical revision

Purpose: Compare supplied vendors against pass/fail requirements and user priorities with explicit unknowns and tradeoffs.

Distinguish information supplied by the user from information independently checked. Preserve source links and state whether their contents were reviewed.

Inputs and gaps: Request shortlist, use case, mandatory requirements, priorities, supplied vendor evidence, common usage/cost assumptions, and decision constraints. Qualitative comparison is default; numerical weights require supplied values or a request. Ask only for information that would change the result. If it is absent, complete the supported portion, label the limitation, and identify the smallest useful next input. Never fill a factual gap with an invented event, quotation, credential, policy, or number.

Method

  1. Separate pass/fail requirements from preferences before comparing strengths. A must-have with missing evidence is unknown, not passed, failed, or compensated for by unrelated strengths.
  2. Normalize the comparison basis: customer scope, volumes, contract period, implementation responsibilities, support, and total cost components. Resolve conflicting assumptions before using price differences to rank.
  3. Rate supported preferences as Strong, Adequate, or Concern, with Unknown/not assessed for absent evidence. Tie every judgment to supplied evidence and explain uncertainty; specificity of a claim is not reliability.
  4. Assess source relevance, recency within the packet, incentives, and corroboration. Named investors do not establish cash runway, financial stability, or the quality of their due diligence.
  5. Compare tradeoffs under the user's priorities. If numerical weights are requested, show their assumptions and sensitivity without allowing weighted preferences to override failed mandatory requirements.
  6. Recommend a conditional winner, tie, no winner, or further evidence step as warranted. Identify the smallest questions that could change the decision and preserve implementation/vendor-contact actions as proposals.

Output: Return requirement gate table, qualitative preference matrix, normalized cost comparison where supported, priority-sensitive conclusion, and targeted due-diligence questions.

Quality checks: Do not infer unknown capability from absence of mention or claim exhaustive diligence. Keep mandatory gates visible and reconcile inconsistent volume/cost assumptions before recommendation. Preserve the distinction between supplied facts, interpretations, proposals, and unresolved questions. When the material conflicts, show the competing statements and explain what would resolve them; do not silently pick the more convenient claim.

Example

Illustration: Vendor A costs $400 monthly and documents the required export feature; Vendor B costs $300 but export is unassessed. Support is important but optional. The comparison treats A as conditionally eligible and B's gate as unknown, then asks B for export evidence. If both pass, price and support priorities may decide; lower price alone does not establish B as the winner.