All field notes

Question ·

What should you ask a sales coaching vendor before you buy?

Ask a sales coaching vendor to coach a live deal in your method and show how its scores hold up. Ten questions, and what a good answer sounds like.

Ask a sales coaching vendor to coach one of your live deals in your own method, then ask how its scores compare with your managers' and what changes when the same call is scored twice.

Most buying checklists stop at features and price. The questions below test the thing a coaching product is for: whether a rep leaves a session with a better next conversation, and whether a manager can trust what it reports.

The short version

Treat the vendor conversation as a trial, with your material. Bring a live deal, a few recorded calls your managers have already ranked, and your scorecard. Then ask each question below and write down the answer next to what you expected. A vendor that answers with a demo of its own example has not answered.

Ten questions, and what a good answer sounds like

  1. Will you coach one of our live deals, on a call, today? A good answer is yes, followed by questions about what the buyer said. A score with no next move is a report.
  2. How do you coach in our method? A good answer uses your method's terms unprompted. If you run MEDDPICC, it should ask about the economic buyer and the paper process without being led there.
  3. How do your scores compare with our managers' order of the same calls? A good answer is a number from a test, with the size of the sample. "Very accurate" is no answer.
  4. What changes if you score the same call twice? A good answer names a share of scores that moved. In our own research, one leading AI model changed 15% to 17% of its scores between identical runs.
  5. Is every quote in the feedback in the transcript? A good answer explains how quotes are checked before a rep sees them. In our testing, a cheap extraction step produced quotes of which a fifth were not in the call.
  6. What does the coach remember next week? A good answer is that it opens the next session with the last agreed move and asks whether it happened.
  7. What does a manager see on Monday? A good answer is a short read across deals, by what each is missing, so the manager knows which one-on-one to spend time on.
  8. Which AI model runs it, and what happens when that model is retired? A good answer names the model and the plan for re-testing on a new one.
  9. Where do our transcripts go, and who processes them? A good answer names every processor and makes hedged, specific claims. Read ours on our security page.
  10. What does a pilot look like, and what counts as a pass? A good answer is a written pass line agreed before the pilot starts.

The full set of tests behind these questions, with pass lines, is in how to evaluate AI sales coaching software.

What to ask a sales coaching vendor
  • Will you coach one of our live deals?
  • How do you coach in our method?
  • How do your scores compare with our managers?
  • What changes if you score the same call twice?
  • Is every quote in the feedback in the call?
  • What does the coach remember next week?
  • What does a manager see on Monday?
  • Where do our transcripts go?

An example

This example is illustrative. The enablement lead at Arrowmere, a 600-person logistics firm, meets two vendors in the same week. She brings the same open deal to both: a $120,000 renewal with a new CFO who has not joined a call.

The first vendor shows a dashboard and offers to score the deal's last call. The score is 6 out of 10 on qualification, with no quote and no suggestion. The second vendor's coach asks what the champion said the current contract costs them in missed deliveries, then asks who briefed the new CFO. It suggests the rep open the next call by asking the champion for twenty minutes with the CFO before the renewal date. Only one of the two coached the deal. She takes the second into a four-week pilot with a pass line written down first, using the steps in how to run an AI sales coaching pilot.

Where Replicate Labs fits

Replicate Labs builds AI sales experts that coach in the team's own method. A rep can start a call with Caty in one click and talk through a live deal by voice or video, with typing as the fallback. For a wider view of the market before you shortlist, see our comparison of AI sales tools, or talk to us and bring a deal.

FAQ

What should I ask a sales coaching company before signing?

Ask them to coach a live deal of yours in your method, show how their scores compare with your managers', explain where transcripts go, and agree a written pass line for a pilot.

How do I compare sales coaching vendors fairly?

Give every vendor the same live deal, the same ranked calls and the same scorecard, and record each answer against a pass line you wrote before the first meeting.

What is a red flag when buying sales coaching software?

A vendor that cannot run your own deal in the meeting, or cannot give a number for how its scores compare with human assessors, has not tested the thing you are buying.

How long should a sales coaching pilot last?

Four to six weeks is common, long enough for a rep to bring the same deal back several times. Agree the pass line and the deals in scope before the pilot starts.

Put an expert on your deals.

Talk to Keenan about a live deal for free, or talk to us about experts for your team, your product or your coaching business.

Talk to us