Comparing vendor focusing only on price may lead to inappropriate approach and loss of enormous potential loss. In this article, we will get a holistic idea on how to compare vendors and which impactful parameters should be considered in marking during evaluation.
Vendor
Comparison
Criteria
Choosing the wrong vendor isn’t just a procurement failure — it’s a risk event. A structured, multi-criteria evaluation framework is what separates professional procurement from gut-feel purchasing. This complete guide covers every dimension of vendor comparison: technical, financial, and non-financial — drawn from real-world bid evaluations.
01Why Structured Vendor Comparison Matters
Procurement is not shopping. When an organisation evaluates multiple vendors for a significant contract — whether for goods, services, capital equipment, or projects — the decision carries financial, operational, and reputational consequences that can last years.
A structured vendor comparison framework introduces objectivity into what can otherwise become a subjective, politically influenced, or price-only decision. It ensures that every bid is evaluated against the same criteria, in the same sequence, with a defensible score — a requirement for most organisations operating under good governance principles and particularly for those subject to audit.
Consider this: two vendors may quote nearly identical prices, but one may offer superior delivery lead times, better warranty terms, stronger local after-sales support, and a stronger financial track record. Without a structured comparison, the price-matching vendor wins by default. With a proper framework, the better long-term partner wins.
Definition: Vendor Comparison Criteria are the specific, pre-defined, weighted parameters against which competing vendors are systematically evaluated and scored during a bidding or tendering process. The result is a composite score that enables objective selection of the best-value supplier — not merely the lowest price.
02The Three-Pillar Scoring Framework
Professional procurement organises vendor evaluation across three primary pillars, each with its own criteria categories, standard scores, and weighting. Together, these produce a Total Composite Score that provides the basis for award recommendation.
The sum of scores across all three pillars — normalised to a percentage — gives the Total Score in % for each vendor. In a real-world bid evaluation, this might look like: Vendor A: 83.4% vs Vendor B: 77.1% — the basis for an award recommendation with full audit defensibility.
Key principle: The standard scores and weightings must be defined before bids are received and opened, never after. Post-bid criterion adjustment is a governance violation that exposes the procurement process to challenge, fraud allegations, and legal dispute.
03Technical Criteria
Technical evaluation assesses whether a vendor is capable of delivering what is required — at the right quality, from the right sources, with the right methodology. It is the first filter: a vendor who fails minimum technical thresholds should be disqualified before commercial or financial scoring begins.
Technical Compliance
Does the vendor's offer meet all specified technical requirements? This covers material specifications, product standards (ISO, ASTM, BS), engineering drawings, and scope of supply completeness. Partial compliance must be flagged and scored accordingly.
Brand & Origin of Supply
Are the proposed brands and origin of supply acceptable to the client's engineering/technical team? For imported items, OEM (Original Equipment Manufacturer) supply is typically preferred over third-party distributors. This affects warranty validity and availability of spare parts.
Installation Methodology
Does the vendor have a clear, competent plan for installation, testing, and commissioning? For complex technical projects, a detailed methodology statement and site mobilisation plan are evaluated here.
Quality Assurance System
Does the vendor operate a documented QA/QC system? ISO 9001 certification, internal audit records, inspection test plans (ITPs), and quality control procedures are evaluated here.
Spare Parts Stockability
Can the vendor guarantee availability of critical spare parts locally? For equipment and system contracts, the ability to supply local spare parts — without waiting for overseas procurement — significantly reduces operational downtime risk in the warranty and post-warranty period.
Technical Team Competency
Are the vendor's nominated engineers and technicians qualified and experienced? CVs of key personnel, professional certifications, and relevant project experience are reviewed. For complex projects, this can be a pass/fail criterion.
Procurement tip: Always conduct a Technical Pre-Qualification stage before inviting vendors to bid commercially. This protects the process from commercially attractive bids that are technically undeliverable — and avoids wasting evaluation time on non-compliant submissions.
04Financial / Commercial Criteria
Financial scoring goes well beyond comparing quoted prices. A professional procurement team evaluates the total cost of ownership, the structure of the offer, payment terms, and the vendor’s own financial capacity to perform the contract. The lowest price is not always the highest financial score.
Cost Components in Financial Evaluation
Import Supply Cost (USD/BDT)
For imported items, the CIF or FOB value quoted by the vendor, converted to local currency at the prevailing exchange rate. Must include freight, as some vendors quote net of freight. The landed cost in BDT is the true comparable — not the USD quote alone.
Local Supply Cost (BDT)
Cost of locally sourced materials, components, and consumables. Must include VAT where applicable. Discounts offered must be clearly documented and reflected in the net comparable price.
Installation, Testing & Commissioning
The all-in cost of installation and commissioning services. Evaluated separately from supply cost, as some vendors bundle this at a premium while others offer it competitively to win the supply portion.
Total Cost Comparison
The composite of all above: Import Supply (Landed in BDT) + Local Supply (incl. VAT) + Installation & Commissioning. This is the true apples-to-apples comparison value used to determine bid competition level and cost differential percentage.
Financial Scoring Formula
The standard method: Score = (Lowest Bid Value ÷ Vendor’s Bid Value) × 100. The lowest bidder always scores 100. Others score proportionally less. A vendor quoting 4.29% above the lowest bidder scores 95.71 — preserving the differential mathematically.
Vendor’s Financial Capacity
Can the vendor financially sustain the contract? Annual turnover, net worth, bank credit lines, and audited financial statements are reviewed to assess capacity to mobilise, procure materials, and manage cash flow without defaulting mid-contract.
Worked Financial Comparison
Result: Vendor A is the lowest bidder (BDT 8,516,386). Vendor B is 4.29% higher. Financial Score: Vendor A = 100.00, Vendor B = 95.71. The difference in value = BDT 365,370 — a meaningful number at project scale, but not the only factor in the final award decision.
05Non-Financial Criteria
Non-financial criteria are the procurement team’s way of quantifying what price alone cannot capture — the risk, reliability, responsiveness, and responsibility dimensions of a vendor relationship. Each criterion is scored on a defined scale (typically 1–5 or 0–5) with a descriptive standard for each score level.
Below are the key non-financial criteria used in professional bid evaluations, drawn from real project procurement practice:
| Criterion | Scale | What It Evaluates |
|---|---|---|
| QUALITY & SUPPLY | ||
| Quality of supply & works | 1–5 | Standard, brand, and scope of supply relative to specification; vetted by technical team |
| Order confirmation criteria | 1–5 | Whether vendor confirms orders via PO for local items, PO & LC for imports — correct commercial practice |
| Beneficiary of LC (for imports) | 1–5 | Preference for OEM or brand principal as LC beneficiary vs. third-party trading company — affects genuineness of supply |
| DELIVERY & LOGISTICS | ||
| Shipment from / Port of Origin | 1–5 | Supplier country; affects freight cost, lead time, and supply chain risk |
| Delivery lead time (Import — from LC) | 1–5 | Weeks from LC opening to CFR at CTG port. Shorter = higher score |
| Delivery lead time (Local — from PO) | 1–5 | Weeks from PO placement to delivery at site. Critical for project timelines |
| Delivery lead time (Installation/commissioning) | 1–5 | Weeks from import arrival to site handover; accounts for commissioning complexity |
| Partial shipment (for imported items) | 1–5 | Whether partial shipment is agreed. If not allowed per spec, full compliance = highest score |
| PAYMENT TERMS | ||
| Payment Term — Import Items | 1–5 | Sight LC, usance LC, deferred payment. More favourable terms (longer credit) = higher score |
| Payment Term — Local Items & Services | 1–5 | Days after invoice submission. 60+ days credit more favourable to buyer than 15 days |
| Payment Modality | 1–5 | Partial bill submission and payment accepted? Milestone-based flexibility improves cash flow management |
| Retention Money | 1–5 | Percentage of PO value retained as performance security until handover/warranty. Lower % = higher score |
| WARRANTY & AFTER-SALES | ||
| Warranty for materials | 1–5 | Duration and start point of material warranty. Longer coverage starting from commissioning is preferred |
| Warranty for workmanship | 1–5 | Duration of defect liability for installation/commissioning works |
| After-sales support | 1–5 | Own team vs OEM — in-house warranty service team preferred; OEM-only support less reliable |
| Response time — service warranty | 1–5 | Hours within which vendor responds to warranty service request. 24 hrs or less = higher score |
| Resolution time — local items | 1–5 | Hours to replacement/fix for locally supplied items under warranty |
| Resolution time — imported items | 1–5 | Weeks for replacement of imported items. Vendor’s stock availability and logistics matter here |
| Cost responsibility for replacement | 1–5 | Who bears cost of replacement including customs, freight, delivery. Full vendor responsibility = highest score |
| Return of faulty items | 1–5 | Vendor or third party manages return logistics? Vendor-managed is preferred |
| Routine inspection in warranty period | 1–5 | Frequency of proactive site inspections during warranty. Monthly or quarterly preferred |
| Spare parts stockability | 1–5 | Range and availability of critical spare parts locally. Wider range = higher score |
| After-sales service post-warranty | 1–5 | AMC/STMC (Annual/Scheduled Maintenance Contract) availability. Structured AMC preferred |
| COMMERCIAL TERMS | ||
| Penalty / LD clause compliance | 1–5 | Acceptance of Liquidated Damages clause for delay — including escalating weekly percentages. Full acceptance = highest score |
| Sub-contractor assignment | 1–5 | Does vendor propose to self-perform, or sub-contract? Self-performance = higher accountability |
| Performance guaranty | 1–5 | Bank/bid bond provided? Agreed unconditionally? Higher commitment = higher score |
| Security deposit | 1–5 | Readiness to provide security deposit. Confirmed readiness = higher score |
| Financial capacity | 1–5 | Vendor’s own financing capability; self-financed operations preferred over fully client-advance-dependent models |
| HSE & COMPLIANCE | ||
| HSE competency | 1–5 | Commitment to safety protocols: PPE, flashback arrestors, fall protection, height safety, penalty acceptance for violations, and property damage liability acceptance |
| EXPERIENCE & RESPONSIVENESS | ||
| Experience with client organisation | 0–1 | Prior supply/service to the same client. Binary — yes or no |
| Experience on same/similar project | 0–1 | Track record on comparable project scale/type. Binary |
| Experience with other organisations | 1–5 | Reference projects with comparable organisations in the same industry sector |
| Responsiveness during bidding | 1–5 | Quality and speed of clarification responses; communication professionalism during tendering |
| Vendor’s site visit (executed) | 1–5 | Did the vendor’s team physically visit the site before bidding? Reduces scope errors post-award |
06Score Weighting & Normalisation
Raw scores across the three pillars are not directly comparable — each has a different maximum. Weighting and normalisation convert them into a single, comparable total. The methodology must be defined upfront in the evaluation plan.
Weight (typical)
Weight (typical)
Weight (typical)
(weighted composite)
Normalisation Formula
Each pillar score is normalised before weighting:
Real-World Score Example
07The Evaluation Process Step-by-Step
A rigorous vendor evaluation follows a defined sequence. Skipping steps or changing the sequence invalidates the process and creates governance risks.
Define Requirements & Scope of Work
Before any vendor is approached, the technical team produces a complete scope of work, specifications, and deliverable list. This is the foundation — ambiguous scope leads to incomparable bids.
Design the Evaluation Framework
Define all criteria, standard scores, and weightings before the tender is issued. The bid evaluation plan is locked and signed off by procurement and relevant stakeholders. No criterion can be added or removed after bid opening.
Pre-Qualify Vendors (if applicable)
Issue a Request for Information (RFI) or Pre-Qualification Questionnaire (PQQ) to screen vendors for minimum technical capability, financial standing, and regulatory compliance before inviting them to bid. Only pre-qualified vendors receive the full Request for Proposal (RFP) or Invitation to Tender (ITT).
Issue Tender & Conduct Site Visit
Issue the tender documents including all specifications, commercial terms, evaluation criteria summary, and instructions to bidders. Conduct a mandatory site visit with all bidders together — same information to all, documented in minutes.
Receive & Open Bids
Bids are received by the closing deadline and opened in a controlled process — typically in the presence of multiple authorised parties. Commercial (price) and technical envelopes may be opened separately in a two-envelope system.
Technical Evaluation
The technical team scores each bid against technical criteria. Non-compliant bids may be rejected at this stage. Technical clarifications are sought in writing — no verbal commitments accepted.
Commercial & Financial Evaluation
Procurement normalises all prices to the same basis (e.g. landed cost in BDT). Financial scores are calculated using the normalisation formula. Non-financial criteria are scored by the evaluation committee.
Clarification & Best & Final Offer (BAFO)
Seek written clarifications on any ambiguities. If permitted by the process, invite top-ranked vendors to submit a Best & Final Offer. All BAFO requests must be identical across vendors.
Composite Scoring & Award Recommendation
Apply weightings, calculate total scores, rank vendors. Prepare the Bid Evaluation Report (BER) with full scoring transparency, narrative justification for scores, and a formal award recommendation to the relevant authority.
Approval & Award
The BER is reviewed and approved by the appropriate authority (Procurement Committee, CFO, Board — depending on value). Upon approval, a Purchase Order or Contract is issued to the winning vendor. Unsuccessful vendors are notified with appropriate debriefing.
08Real-World Bid Evaluation — Key Takeaways
The images shared by the author reflect a genuine industrial project bid evaluation — likely for an MEP (Mechanical, Electrical & Plumbing) or fire & safety system installation in Bangladesh. The evaluation compares two vendors: Vendor A (MEP) and Vendor B (Safety Solution). Key observations from a procurement professional’s perspective:
Key insight: Vendor A won on financial score (lowest price, 100 pts) and non-financial score (better commercial terms, OEM supply, broader spare parts). Despite a higher technical score, Vendor B’s refusal to provide a performance guaranty, reliance on a third-party LC beneficiary, and limited spare parts availability were significant governance and operational risk flags that the evaluation framework correctly captured and penalised.
09Common Vendor Evaluation Mistakes
✓ DO
- Define criteria and weights before bid opening
- Evaluate all bids on the same normalised cost basis (landed cost in BDT)
- Document every score with a written justification
- Send identical clarification questions to all vendors
- Include HSE and LD clause compliance as scored criteria
- Check LC beneficiary identity for import items
- Verify spare parts availability, not just price
- Compare warranty start date (shipment vs commissioning)
- Have the technical team sign off on quality scores
- Archive all bid documents for audit purposes
✗ DO NOT
- Award solely on lowest price without composite scoring
- Add or change criteria after bids are opened
- Accept verbal commitments during clarification
- Compare USD quotes without converting to landed BDT cost
- Ignore partial shipment clauses for imported items
- Accept bids from vendors who didn’t attend the site visit
- Score “experience” without verifiable reference projects
- Overlook a vendor’s refusal to accept LD/penalty clauses
- Allow one evaluator to determine non-financial scores alone
- Proceed to award without written committee sign-off
10Best Practices for Procurement Teams
Use a Standardised Evaluation Template
Maintain a standard bid evaluation template for your organisation that can be adapted per project. Consistency across evaluations builds institutional knowledge and reduces preparation time for each new bid.
Two-Envelope System for Complex Bids
For high-value or technically complex bids, use separate technical and commercial envelopes. Open and evaluate technical submissions first — without knowing prices — to prevent price anchoring in technical scoring.
Evaluation Committee, Not Individual
Non-financial scores should be assigned by a committee of at least 3 members: technical lead, procurement lead, and a user department representative. Averaged scores reduce individual bias.
Conduct Vendor Due Diligence
Beyond the submitted documents, verify vendor claims: check trade licences, call reference project contacts, verify bank guaranty formats with your treasury team. Do not take bid commitments at face value for critical criteria.
Calibrate Score Descriptors
For each non-financial criterion, write a clear descriptor of what constitutes a score of 1, 2, 3, 4, and 5. Without this calibration, two evaluators will score the same response differently, undermining consistency.
Debrief Unsuccessful Vendors
Provide a structured debrief to unsuccessful vendors on request — explaining where they lost points. This improves the quality of future bids, supports vendor development, and demonstrates procurement transparency.
11Frequently Asked Questions
Answers to the most common questions procurement professionals and students ask about vendor comparison and bid evaluation.
Financial criteria compare total costs on a normalised basis — converting all bids to the same currency and cost basis (e.g. landed cost in BDT) and scoring them proportionally, where the lowest bidder always receives the maximum score.
Non-financial criteria capture everything else that affects value and risk: delivery lead times, payment terms, warranty coverage, penalty clause acceptance, HSE commitment, experience, and responsiveness. These are scored on a defined scale (typically 1–5) and represent the “soft” but critically important dimensions of a vendor relationship.
• Deliver inferior quality materials that fail earlier and cost more to replace
• Offer unacceptable delivery lead times that delay a critical project
• Refuse to accept Liquidated Damages clauses, shifting delay risk to the client
• Lack an adequate after-sales support team, leaving you stranded during warranty issues
• Source from third-party distributors rather than OEMs, risking counterfeit or misrepresented goods
A structured evaluation framework captures all these dimensions. In the real-world example analysed in this post, the lowest bidder won — but only because they were also superior on non-financial criteria. In many evaluations, a slightly higher-priced vendor offers significantly better total value once all criteria are scored.
Financial Score = (Lowest Bid Value ÷ This Vendor’s Bid Value) × 100The lowest bidder always receives a score of 100. Other vendors are scored proportionally lower based on how much more expensive they are.
Example: Lowest bid = BDT 8,516,386 | Vendor B bid = BDT 8,881,756
Financial Score B = (8,516,386 ÷ 8,881,756) × 100 = 95.71This means Vendor B is 4.29% more expensive, and their financial score reflects this precisely. The formula is mathematically fair and fully auditable.
• 1.5% of PO value per week for the 1st week of delay
• 2.5% of PO value per week for the 2nd week
• 5.0% of PO value per week from the 3rd week onward
LD clauses are a scored non-financial criterion because they reflect the vendor’s confidence in their delivery commitments and their willingness to take contractual accountability. A vendor who refuses the LD clause is, in effect, declining accountability for delays — a significant risk flag. Full acceptance of the LD clause = highest score.
OEM / Brand Principal as beneficiary (e.g. NAFFCO, UAE) → Goods are supplied directly from the manufacturer. Higher assurance of genuine, specification-compliant products. OEM’s brand reputation is on the line.
Third-Party Trading Company as beneficiary (e.g. Taxila Impex Pte, Singapore) → A middleman is involved. The actual source of supply is less transparent. Risk of sub-standard substitution, expired stock, or counterfeit products is higher. Also, the OEM’s warranty may not be valid for goods sold through unauthorised distributors.
This is why OEM or brand principal as the LC beneficiary is always preferred and scored higher in professional procurement evaluations.
• Genuine price competition (single or dual bids may not represent market rates)
• Comparative non-financial benchmarking across different vendors
• Audit defensibility — most governance frameworks require 3+ bids for awards above a threshold
For highly specialised or sole-source items, fewer bids may be acceptable with documented justification. For large, complex projects, more than three vendors may be invited to pre-qualify, with shortlisting to 3–5 for the full ITT. Inviting too many vendors (10+) increases evaluation burden without proportional competitive benefit.
Warranty from shipment date: The warranty clock starts when the goods leave the supplier’s factory or port. If the goods take 14 weeks to arrive and are installed over 4 more weeks, the buyer has already used 18 weeks of a 12-month warranty before the system is even operational. This is unfavourable to the buyer.
Warranty from commissioning date (preferred): The warranty clock starts when the system is fully installed, tested, and handed over. The buyer gets the full warranty coverage period on an operational system. This is the preferred and more equitable arrangement.
For imported items, best practice is “12 months from commissioning date OR 18 months from shipment date, whichever comes first” — protecting both parties. The start date is a scored non-financial criterion in rigorous evaluations.
It should be included in the vendor evaluation because:
• Post-warranty operational continuity is critical for complex systems (fire safety, MEP, HVAC)
• A vendor who offers AMC has an incentive to install correctly the first time — they will service it themselves later
• AMC availability from the original vendor avoids multi-vendor coordination problems in operations
In evaluation, a vendor offering a structured AMC/STMC programme scores higher on the “after-sales service after warranty period” criterion than one offering only ad-hoc repair services.
• Invalidates the entire evaluation process
• Creates grounds for legal challenge by unsuccessful vendors
• Exposes the organisation and the evaluators to allegations of collusion or corruption
• Is prohibited under virtually all procurement regulations, public and private
If a genuine error or omission is discovered in the criteria before bid opening, the proper process is to issue a formal tender addendum to all bidders, reset the submission deadline, and allow vendors to revise their submissions. Even this must be done transparently and with equal communication to all parties.
• Safety policy and commitment: Does the vendor have a documented HSE management system?
• PPE compliance: Commitment to full PPE provision — safety harness, welding guards, flashback arrestors, fall protection — at all height levels
• Incident penalty acceptance: Willingness to accept financial penalties (e.g. BDT 5,000 per unsafe activity/event) for HSE violations during works
• Property damage liability: Acceptance of full liability for any loss or damage to client property caused by unsafe practices
• LTIR/TRIR history: Lost Time Injury Rate and Total Recordable Incident Rate from prior projects
A vendor who accepts all HSE obligations unconditionally scores the maximum. Partial commitment or refusal to accept penalty clauses is a red flag and scored accordingly.
// Sources & References
- CIPS (Chartered Institute of Procurement & Supply). Supplier Evaluation and Selection. cips.org
- IACCM / World Commerce & Contracting. Best Practices in Supplier Evaluation and Scoring. worldcc.com
- World Bank. Procurement Framework — Evaluation Criteria and Scoring Methods. worldbank.org
- Asian Development Bank (ADB). Procurement Policy — Bid Evaluation Guidelines. adb.org
- Office of Government Commerce (UK). Sourcing Guide — Evaluation and Scoring. OGC Archive
- Procurement Insights. Non-Financial Evaluation Criteria in Competitive Tendering. procurementinsights.com
- Original Bid Evaluation Documents. Real-World Project Bid Comparison — Innova MEP vs. Zenith Safety Solution (provided by author as case study reference — details anonymised for publication).
- Deloitte. Global CPO Survey 2025 — Procurement Governance and Vendor Evaluation Trends. deloitte.com
🔗 Recommended Reading
Master in procurement by exploring these related guides.
Total Landed Cost GuidebookFormula, Calculation & Examples for Procurement Read More → |
Procurement Interview QuestionsTop 300 Procurement Interview Questions: Fresher, Intermediate & Senior Professional Guide Read More → |
You can reach me out by filling below form to contact with me

No comments:
Post a Comment