Win-loss analysis: how to hear why buyers really said no (and yes)
Win-loss analysis means interviewing won and lost buyers soon after they decide, then comparing the groups. How to scope it, how many to talk to, who asks and what.
Win-loss analysis is how you find out why deals actually close: interview buyers soon after they decide, both those who chose you and those who chose someone else or nothing, then compare the two groups. It swaps the one-word reason a salesperson types into the CRM for the buyer's own account of the evaluation. MaRS describes it as research into why you win or lose a specific sale, with findings that feed product, pricing, positioning, sales and competitive work.
The five sections below cover the choices. For one lost-buyer conversation in depth, see how to interview customers who chose another product.
Your win rate says how often. Interviews say why
Here is a made-up example, and all its figures are hypothetical. You sell inspection software to commercial construction contractors and close about 120 deals a quarter: 30 won and 90 lost. Product Marketing Alliance gives the two basic formulas:
- Win rate = won opportunities ÷ total opportunities = 30 ÷ 120 = 25%
- Win/loss ratio = won opportunities ÷ lost opportunities = 30 ÷ 90 = 0.33
The interviews add whether the reasons differ by competitor, deal size or segment.
1. Study one narrow slice of deals first
Clozd, a win-loss vendor, argues that themes vary widely across business units and product lines, and that narrowing the focus, for example to deals against a single competitor, lets you learn more from fewer interviews. For the inspection software company, a good first scope is mid-sized contractors that evaluated you against your most common competitor.
Include wins as well as losses. PMA recommends aiming for an even number of each so the results are not skewed, while noting that lost buyers are harder to get on a call and deserve extra effort. Without wins, you can't tell whether a complaint from lost buyers also came up in deals you won.
Include "no decision" outcomes if they are common. A buyer who kept using spreadsheets tells you something different from one who chose a competitor. (The spreadsheet is a tough competitor. It is already installed.)
2. Interview until new themes stop showing up
Anyone quoting a precise sample size should explain the scope behind it.
- PMA says there is no set number and suggests building a few interviews into each interviewer's week so the program keeps running.
- Clozd frames the goal as saturation, the point where new interviews stop surfacing new themes. It says meaningful insights can come from as few as 10 interviews in a narrow segment, and that most of its clients settle into 50 to 200 interviews a year, based mainly on budget. That is one vendor's account of its own clients.
For the example, plan six wins and six losses in the chosen scope this quarter, then check whether themes are still changing. You will invite far more people than you interview: PMA's rule-of-thumb example is to ask 20 people if you want to speak with five. At that rate, six of each means inviting about 24 won and 24 lost buyers, which the example pipeline can support.
PMA suggests interviewing within about four weeks of the decision. For wins, get in before the customer is deep into setup, so onboarding doesn't color their memory of why they chose you.
3. Keep the salesperson out of the interview
The rep who worked the deal should not run the interview. Buyers soften criticism when talking to the person it is about, and a rep may be tempted to reopen the deal (understandable, and still a bad idea). PMA suggests product marketing, sales enablement, customer success or product management instead, with a caution that product managers can focus too narrowly on features.
MaRS's interview guidance adds three habits. Tell the buyer you are not from sales and not selling anything. Explain how the feedback will be used and that it will be kept confidential. Aim for the buyer to do roughly 90% of the talking.
When to use a third party. An outside interviewer can get franker answers, and PMA notes that outsourcing gives you objectivity and a set quota of interviews. It costs more and puts distance between you and the raw conversations. Run the first dozen interviews yourself to learn the ground, then decide whether volume or objectivity justifies outside help. PMA lists firms such as Clozd and Primary Intelligence among those that run programs.
4. Ask the same core questions every time
A consistent core makes interviews comparable. Follow up freely on anything interesting:
- The trigger. What was happening that made you start looking? Why then?
- The group. Who was involved in the decision, and what did each person care about?
- The options. Which products or approaches did you consider, including doing nothing? How did you find them?
- The evaluation. What did you need to see to feel confident? What did you test or check?
- The deciding moment. When did it become clear which way you would go? What happened just before?
- Price. How did pricing compare with the other options, and did it change the outcome?
- The sales experience. What was helpful or unhelpful in how each vendor worked with you?
- The counterfactual. What would have had to be different for you to choose otherwise?
Keep the call short. PMA suggests staying within 20 minutes so you don't eat too far into the buyer's day. End with an open question such as "Is there anything we did not ask that mattered?" MaRS notes that some of the most useful points come in the final minutes.
5. Count accounts, not mentions
After each interview, write down the main decision factors in the buyer's words, tagged consistently (for example "mobile offline mode," "price per seat," "implementation time"). Then compare how many won accounts and lost accounts mention each factor. A factor that shows up in most losses and few wins is worth acting on. One that shows up equally in both is probably not what decides deals.
Every quarter, send sales, product and marketing a short summary: the scope, the number of interviews, the top factors in wins and losses, what changed since last quarter and one recommended action per team. Track the win rate for the same scope over the following quarters, keeping in mind that many things besides your changes affect it.
Your next step
Pick one scope, list last quarter's closed deals within it, and invite won and lost buyers this week.
For perspective from buyers outside your pipeline, such as construction IT leaders who picked a competing inspection tool without ever talking to you, search for people by describing their role. The information technology professionals in construction directory page is one place to start. Instant Expert finds people whose work matches your question. You review them, it sends the invitations, and you pay for each call that gets booked.
A quarterly win-loss cycle
- 1
Scope
Pick one segment or competitor and list the quarter's closed deals in it.
- 2
Invite
Invite won and lost buyers within about four weeks of the decision.
- 3
Interview
Someone other than the rep asks the same core decision questions.
- 4
Compare
Count which factors appear in won versus lost accounts and report quarterly.