Supplier Evaluation with Metrics: KPIs for Monitoring Existing Suppliers

A practical guide for procurement professionals: Which KPIs, from OTIF to quality rate to TCO, are suitable for regular supplier monitoring in DACH industry? With steps, examples and a checklist.

Why many supplier evaluations fade away in day-to-day practice

The scenario is similar in many industrial companies: the supplier evaluation exists on paper, was introduced once, perhaps even certified, and is then only maintained irregularly. The buyer does not recognise problems with a supplier from figures, but rather from production asking when the missing parts will finally arrive. That is exactly the moment when evaluation comes too late: the delivery has already failed to arrive, the complaint is on the table, and the alternative would be a tender under time pressure with a weak negotiating position.

Procurement without metrics works reactively. Procurement with metrics recognises earlier when prices rise, inventories become too high or suppliers prove unreliable: that is the difference in a nutshell. Transparency alone, however, is not an end in itself: it is the foundation for supplier conversations based on facts, for making development measures measurable, and for deciding on dual sourcing or alternative sources based on data rather than intuition.

This practical guide shows which metrics are suitable for the regular monitoring of existing suppliers in DACH industry, how to build a metrics system step by step, and which mistakes typically occur along the way. All numerical values cited here come from the underlying research material; where evidence is lacking, the guide deliberately refrains from giving concrete target values.

Fundamentals: What distinguishes a KPI from a mere metric

First, a conceptual clarification that is often overlooked in practice: metrics and KPIs are not the same thing. Metrics are general measurements. Key Performance Indicators, by contrast, are specific performance indicators directly linked to a company's strategic objectives. A practical consequence follows from this definition: not every measurable quantity belongs in a supplier dashboard. A metric becomes a KPI when it is clearly defined, easily measurable, regularly updatable and understandable to decision-makers, and when a decision follows from its movement.

For a KPI to actually work as a management instrument, it should meet four criteria: it should have a clear definition, be updated regularly, be measurable without manual effort, and be understandable to decision-makers. These criteria are a useful filter before you add a metric to your monitoring. A figure that has to be manually assembled from three systems once a quarter will rarely be up to date in practice, and outdated reporting is worse than none at all, because it conveys false confidence.

Then there is strategic alignment: KPIs should be closely interwoven with corporate goals and ideally cover different areas: finance, customers, processes. Transferred to supplier monitoring, this means: a pure cost dashboard does not do justice to a supplier's performance, and neither does a pure quality dashboard. The most effective approaches categorise metrics by outcome categories, such as cost, supplier performance, operational efficiency and strategy, so that the data can be linked directly to business value.

The core KPIs for supplier monitoring at a glance

Several groups of metrics have become established for evaluating existing suppliers. The following table provides an overview of the KPIs most frequently mentioned in the research material, together with what they indicate.

This list is deliberately not exhaustive. However, it covers the metrics that have proven particularly efficient in procurement controlling and that can be maintained on an ongoing basis with reasonable effort. The most important groups are discussed individually below.

OTIF: The core indicator for delivery reliability

Delivery reliability is the classic among supplier KPIs, and OTIF (On-Time In-Full) provides a precise performance metric for it. OTIF indicates whether a delivery is made within the scheduled time frame (On Time) and in the agreed quantity (In Full). Four criteria must be met for a high OTIF score: the delivery contains the right items, matches the agreed quantity, and arrives at the agreed time and the agreed place.

The calculation is straightforward and therefore well suited for ongoing monitoring: OTIF in percent equals (number of complete and on-time deliveries divided by the total number of deliveries) times one hundred. A more differentiated formula also exists, which determines the share of complete deliveries and the share of on-time deliveries separately and multiplies the two.

To put these values in context: one hundred percent is the ideal, but it is hardly achievable in real supply chains: the list of influencing factors runs from sick leave and severe weather to political conflicts in producer countries. As a rule of thumb: OTIF values of 95 percent and above are generally considered evidence of a highly resilient supply chain and high delivery quality. At values below 85 percent, providers move into a critical range, which indicates a lack of efficiency.

An important methodological note: OTIF should be calculated for a specific period so that improvements and deteriorations in delivery quality become visible along a time axis. A point-in-time value without trend context does not reveal whether a supplier is stabilising or continuously deteriorating.

Quality: quality rate and complaint rate

The quality rate measures the share of defect-free deliveries. It adds to on-time delivery the dimension that is often the most expensive in manufacturing industry: non-conforming material means inspection and rework effort, replacement procurement under time pressure and, in the worst case, stoppages in your own production. Weak suppliers demonstrably cause delays, complaints and additional costs, which is why many companies rely on a combination of quantitative and qualitative KPIs.

The complaint rate makes the problem visible from your company's perspective: it records how frequently complaints are raised with a supplier. Its advantage over the pure quality rate lies in its operationality: a complaint is usually documented, whereas the definition of a defect-free delivery can vary in strictness depending on the depth of inspection. It is important that both metrics are reported per supplier and not only in aggregate. An average across the entire supplier base conceals the outliers that should actually be the subject of the conversation.

Cost: TCO instead of purchase price

For the monetary evaluation of existing suppliers, the Total Cost of Ownership is the key metric. The indicator takes into account all direct and indirect procurement costs of a good or service. It deliberately goes beyond the purchase price: transport costs, inspection effort, rework, warehousing and process costs are included. Especially with suppliers who appear cheap in the benchmark, the TCO view often reveals that quality weaknesses and delivery fluctuations eat up the price advantage.

It is also worth looking at the cost per order. This metric captures the average effort involved in processing a single order, from demand capture to approval, including all associated process costs. If this value rises, it is often an indication that automation or process optimisation is needed. The relevance to supplier monitoring: a supplier whose orders can only be processed manually and with numerous queries causes ongoing process costs on your side, which should be made visible in the supplier evaluation.

Besides TCO and process costs, two further monetary KPIs are anchored in the research material: the savings rate, which shows procurement's measurable contribution to the company's bottom line and distinguishes genuine price improvements from mere market movements, and the price deviation, which compares planned and actual prices and reveals potential savings opportunities. Cost avoidance: cost traps prevented through proactive measures such as price guarantees, specification changes or demand management: is less visible in annual financial statements, however, but it underscores procurement's foresight in reducing future risks.

The SRM score: combining quantitative and qualitative factors

While on-time delivery is a purely numerical construct, the SRM score (Supplier Relationship Management score) involves an overall assessment: a composite rating from quality, price, communication, flexibility and on-time delivery. It is precisely this mix that makes the KPI meaningful. A supplier can score green on all measured values and still be unreliable in day-to-day collaboration: for example because queries go unanswered or capacity commitments are not honoured.

For practical use, this means: the SRM score is not a substitute for the individual metrics but their synthesis. It works well as an aggregate for supplier conversations and for the annual strategic decision about which suppliers should be developed, which retained and which gradually replaced. Crucial to its robustness is that the sub-criteria, communication and flexibility in particular, are captured using a documented rating methodology, so that results remain comparable over time and across evaluators.

Inventory and process metrics as context

Supplier performance shows not only at the supplier but also in your own inventory. Three KPIs help keep inventory, coverage and demand in balance: inventory coverage, which indicates how long existing inventory will last; inventory turnover, which shows how quickly material is consumed or sold; and the overstock ratio, which indicates where too much capital is tied up in the warehouse. Combined with forecast accuracy, you can not only plan inventory but also detect changes in demand before shortages arise.

The relevance to supplier monitoring is obvious: if you observe falling OTIF values at a supplier, you have two avenues of response: the supplier conversation and a temporary increase in inventory coverage for the affected items. Both presuppose that you know your inventory metrics at item level. Anyone who does not keep an eye on their own inventory situation discusses symptoms in the supplier conversation rather than well-founded impacts.

On the process side, the maverick buying rate deserves attention. It shows how many orders bypass the purchasing department: a frequent sign of missing transparency or unclear responsibilities. This KPI is relevant to supplier monitoring because purchases made outside the regulated process distort your supplier data: if part of the order volume with a supplier goes unnoticed, your monitoring does not accurately reflect that supplier's actual business volume and load profile.

Step by step: how to build your supplier monitoring

A functioning metrics system is not created by the longest KPI list but by a clean sequence. The following six steps have proven to be a pragmatic way to get started.

1. Clarify objectives: first define which strategic corporate goals the supplier monitoring should serve: for example supply capability, cost stability or risk reduction. KPIs are directly linked to strategic corporate objectives; without this link, they remain measurements without steering effect.
2. Segment suppliers: do not evaluate all suppliers with the same effort. Critical A-suppliers with high volume or single-source character deserve closer monitoring than C-item suppliers. The segmentation determines data source, frequency and depth of metrics.
3. Select core KPIs: start with a manageable number: a sensible starting combination is OTIF, quality and complaint rates, plus TCO. Check each metric against the stated quality criteria: clear definition, regular updating, measurable without manual effort, understandable to decision-makers.
4. Define definitions and data sources: document in writing how OTIF is calculated (simple or differentiated formula), which period applies and which systems the data comes from. Without uniform definitions, figures are not comparable between departments.
5. Define frequency and escalation: specify at which intervals which KPIs are reported and at which thresholds measures are triggered: for example a supplier conversation at critical OTIF values below 85 percent.
6. Review regularly: KPIs must be reviewed regularly and adjusted to changing market conditions. A metrics system is a living instrument, not a reporting system set up once and for all.

Concrete examples: metrics in interplay

Monitoring unfolds its greatest effect when metrics are not viewed in isolation but read in combination. Three typical constellations arising from the interplay of the KPIs discussed:

Case 1: high on-time delivery, high complaint rate

A supplier delivers on time and in full, and the OTIF metric looks good. Yet the complaint rate is rising. This constellation shows that the supplier keeps dates and quantities flexible: possibly at the expense of quality inspection or by shipping untested goods. The right response is not to praise the delivery reliability, but to jointly analyse the causes of complaints and to look at the TCO view: inspection and rework costs erode the seemingly attractive price.

Case 2: rising cost per order with stable material prices

Prices are stable, but the cost per order is rising. The context from the research material reads: if this value rises, it is often an indication that automation or process optimisation is needed. In the supplier context, this can mean that the supplier does not transmit its order confirmations, delivery notes or invoices digitally or not in a standards-compliant format. That is a topic for the supplier conversation, and an argument that carries weight in the next negotiation or when selecting alternative sources.

Case 3: falling OTIF and growing inventory coverage

A supplier's OTIF drifts below the critical threshold of 85 percent. At the same time, you observe that inventory coverage for the affected items is rising, because your team is building safety stock on its own initiative. This combination shows two things: the monitoring works, because the operational level has reacted. And it ties up capital that becomes visible in the overstock ratio. The strategic decision then is: supplier development, dual sourcing or building an alternative source: for example through a targeted supplier search on vetted marketplaces such as Amplifa, where technical buyers can access verified manufacturing suppliers.

These examples make the basic principle clear: individual metrics often describe only one situation. Only the combination of several KPIs shows whether something is moving in the right direction, and where the cause lies.

Common mistakes in supplier monitoring

From the relationships described in the research material, several typical error patterns can be derived that systematically undermine the effectiveness of a metrics system.

• KPI overload without prioritisation: anyone introducing ten or more metrics in parallel loses focus. KPIs are specific performance indicators with a direct link to objectives: any metric that triggers no decision is reporting effort without benefit.
• Missing link to objectives: metrics that are not closely interwoven with corporate goals produce numbers without steering effect. Procurement then continues to work reactively, only with more statistics.
• Manual data collection: KPIs that are not measurable without manual effort are rarely kept up to date in practice. Since spending patterns, supplier performance and process efficiency are often spread across isolated systems, system integration is lacking as the basis for reliable values.
• Price-only focus: a supplier evaluation that primarily measures costs overlooks the fact that weak suppliers cause delays, complaints and additional costs. The combination of cost, quality and delivery KPIs is therefore standard.
• No regular review: key indicators must be reviewed regularly and adjusted to changing market conditions. A KPI catalogue from three years ago may be measuring questions that are no longer decisive today.
• No escalation paths: numbers without consequences change nothing. Without defined thresholds and measures, monitoring remains a reporting system without impact.
• Unclear definitions: if OTIF, quality rate or complaint rate are not clearly defined, two departments deliver different values for the same supplier, and the conversation shifts from substance to methodology.

Checklist: is your supplier monitoring fit for purpose?

Use the following checklist to assess the maturity of your existing supplier monitoring. Every item answered with no is a concrete starting point for improvement.

• Does every KPI in use have a clear, documented definition?
• Are all KPIs derived from system data without manual effort?
• Are the metrics updated regularly and reported at fixed intervals?
• Is every KPI linked to a strategic corporate objective?
• Do your KPIs cover multiple dimensions: delivery, quality, cost and collaboration?
• Do you calculate OTIF over a defined period and look at the trend, not just point values?
• Do you know the thresholds of your core KPIs, such as the critical OTIF threshold of below 85 percent?
• Have you documented escalation measures for threshold breaches?
• Do you segment suppliers by criticality and adjust monitoring depth and frequency accordingly?
• Do you review the KPI catalogue regularly and adapt it to changing market conditions?
• Does your team know the inventory coverage of critical items in order to respond to supply fluctuations?
• Do you measure the maverick buying rate to detect distortions in your supplier data?

Next steps: from a metrics catalogue to active steering

The path from theory to effective supplier steering can be tackled in a few concrete steps. First: review your existing KPI catalogue against the checklist and mark which metrics meet the quality criteria and which do not. Second: define the starting combination of OTIF, quality and complaint rates, plus TCO, for your most important suppliers: including formula, period and data source. Third: define thresholds and escalation measures in writing, so that measurements turn into decisions. As a guide, remember that OTIF values of 95 percent and above indicate a highly resilient supply chain, while values below 85 percent are considered critical.

Fourth: check whether your system landscape can deliver the named KPIs automatically. The data that should tell procurement's success story, spending patterns, supplier performance and process efficiency, are often spread across isolated systems. Without a clear connection between metrics and outcomes, it is difficult to demonstrate procurement's true value. Dashboards and real-time tracking solve this problem structurally.

Fifth: anchor the results in the supplier conversation. Fact and assessment should be kept separate: the metrics provide the factual basis, the assessment of the collaboration, for example as part of the SRM score, the qualitative evaluation. Sixth: gradually expand the monitoring to include strategic dimensions. Procurement leaders today track KPIs that go beyond mere cost savings and also cover supplier reliability, process efficiency and strategic alignment: this is how the function secures credibility with finance, the executive board and regulators.

If you would like to identify alternative or complementary suppliers in parallel, you can specifically search for vetted manufacturing partners. Structured preparation of the tender also helps: for example with the support of an AI-assisted tendering tool that structures requirements and evaluation criteria early on. Supplier monitoring then provides the factual basis on which such decisions can be made cleanly.

Conclusion: a few, cleanly defined KPIs beat many numbers

Supplier evaluation with metrics works when a few, clearly defined indicators are collected regularly and decisions follow from their movement. The core combination of OTIF for delivery reliability, quality and complaint rates for product quality, plus TCO and cost per order for the economic perspective, covers the essential dimensions. The SRM score adds the qualitative collaboration aspect, while inventory and process metrics provide context within your own organisation.

What matters is less the length of the KPI list than its quality: clear definitions, automated collection, regular review and clear escalation paths. With this foundation, you identify bottlenecks early, reduce spending and improve collaboration with your suppliers, and your supplier conversations are based on facts rather than impressions.

Editorially responsible

Leon J. Hermann

COO & Co-Founder at Amplifa

As COO and co-founder, Leon is responsible for scaling Amplifa's operations.

View profile