The product-market fit survey: one question and a 40% line

The product-market fit survey asks how users would feel without your product. The 40% line is a rough signal; follow-up interviews explain the score.

Instant Expert EditorialPublished Updated 4 min read

Run the product-market fit survey once you have real users, and treat the score as a list of people to interview. The product-market fit survey asks your recent users one main question: "How would you feel if you could no longer use [product]?" The answers are "Very disappointed," "Somewhat disappointed" and "Not disappointed," and you look at the share who chose "very disappointed."

The question comes from Sean Ellis. According to Rahul Vohra's account of how Superhuman used it, Ellis benchmarked the survey across nearly a hundred startups and found that companies struggling to grow almost always had fewer than 40% of users answer "very disappointed," while companies with strong traction almost always had more. That 40% line is a practitioner's benchmark, not a statistical threshold.

1. Survey only people who use the core product

Superhuman, following Ellis, included users who had used the product at least twice in the previous two weeks. Vohra writes that you start to get directionally correct results at around 40 respondents.

Leave out people who signed up and never came back, and don't survey anyone twice. Superhuman avoided repeat surveys so they would not distort its tracking over time.

With no product or only a handful of users, you can't run it yet. Talk to people who do the job your product is for, starting with the customer discovery interview script. (Your cofounders all answering "very disappointed" does not count.)

2. Ask four questions and stop

Superhuman's version:

  1. How would you feel if you could no longer use [product]? (Very disappointed / Somewhat disappointed / Not disappointed)
  2. What type of people do you think would most benefit from [product]?
  3. What is the main benefit you receive from [product]?
  4. How can we improve [product] for you?

The three open questions give you the words people use and the reason behind their first answer.

3. Read each answer group differently

Hiten Shah's open research on Slack grouped 731 responses by the first answer; 51% chose "very disappointed." Shah then compared the must-have group's answers on benefits, integrations and improvements with everyone else's.

Vohra's process went further:

  • Very disappointed: Read question 2 to see who the product works for (happy users often describe themselves) and question 3 to find the main benefit.
  • Somewhat disappointed: Split this group by whether they named the same main benefit. Those who did are close; read their answers to question 4 to find what holds them back.
  • Not disappointed: Superhuman chose not to act on this group's requests, reasoning that they were far from loving the product.

When Superhuman first ran the survey, 22% of users said "very disappointed." Narrowing to the kinds of users in that group raised it to 33%, and after three quarters of product work it reached 58%, according to Vohra. That is one company's account of its own results, not an expected outcome.

4. Interview a few people from each group

Shah recommends adding an opt-in to the survey, then talking to selected respondents. NN/g's guidance on surveys draws the same line: surveys suit how-many questions about attitudes, and why questions belong to qualitative methods.

Here is a made-up example. You run an invoicing tool for small construction subcontractors. A third of respondents say "very disappointed," and many name "getting paid faster" as the main benefit. Several "somewhat disappointed" users named the same benefit but asked for lien waiver tracking. Ask a few from each group:

  • Very disappointed users: "Tell me about the last invoice you sent. What did you do before you used us?" You learn what the product replaced and what would make them leave.
  • Somewhat disappointed users who named the same benefit: "Walk me through the last time you needed a lien waiver. What happened?" Is it a recurring job or a nice-to-have?
  • Very disappointed users in a segment you did not expect: "How did you find us, and what were you using before?" A surprise segment may be a better market than the one you planned for.

Ask about specific past events instead of reactions to features. Our customer interview questions and feature request guide have wording you can reuse.

5. The score only covers people who answered

It says nothing about users who ignored the survey, and a score built from a founder's friends or a very early community may look better than the market will be. It also cannot tell you whether a new segment will pay or how large it is.

Use the result to decide who to talk to next. If the interviews point to a segment where you have few users, start from a directory page such as finance professionals in construction and describe the role in a people search.

On Instant Expert, a 15- or 30-minute call fits the interview questions from section 4. If you want one answer, such as how they handle the job your product does today, ask for a written or voice answer instead; it is charged when the answer arrives. Either way the offer is what the person receives and our fee is added on top, so a $50 offer costs $63, and invitations nobody accepts within 7 days cost nothing.