How to measure setter performance, human or AI

Booked calls is a vanity number on its own

It is tempting to judge a setter, whether that is a person or a piece of software, by how many calls end up on the calendar. But a high volume of booked calls that mostly no-show, or mostly turn out to be a bad fit once someone actually talks to them, is not success. It is activity that looks like success until you follow it one step further down the funnel.

Setting performance only means something in the context of what happens after the appointment: did the lead show up, and was the lead actually qualified enough for that conversation to be worth having. A smaller number of well-qualified, well-attended appointments usually beats a larger number of loosely qualified ones, even though the second number looks better on a dashboard.

The four numbers that matter together

No single metric tells the full story, because each one can be gamed or distorted in isolation. Response time without qualification accuracy just measures speed, not usefulness. Qualification accuracy without show rate does not account for leads who agree to a time and then never show. Looking at all four together is what actually reveals whether setting is working.

• Response time: how quickly a lead gets a first reply after reaching out
• Qualification rate: what share of leads engaged actually meet your criteria
• Show rate: what share of booked appointments the lead actually attends
• Booked-to-close rate: what share of appointments convert to a sale or next step

Response time sets the ceiling for everything else

A slow response time caps the other three metrics no matter how good the rest of the process is. A lead who waited hours for a reply is less likely to still be interested enough to qualify well, less likely to show up for an appointment they booked half-heartedly, and less likely to close even if they do show, because their attention and urgency have already moved elsewhere.

This is why response time deserves to be tracked on its own, separately from the other three, rather than folded into a general sense of how the team is doing. It is also the easiest of the four to measure precisely, since it is just a timestamp difference, which makes it a good early warning signal before the downstream numbers even have a chance to move.

Qualification rate needs a real definition, not a feeling

Qualification rate only means something if the business has written down what counts as qualified, ahead of time, rather than deciding case by case after a call goes well or badly. Without a clear definition, this number quietly drifts based on who is judging it and how busy they are that week, which makes it useless for spotting real trends.

A written definition also makes it possible to compare setters, or compare a human setter against an automated one, on equal footing. Two setters booking the same number of appointments can be performing very differently if one is applying a much looser bar for what counts as a qualified lead.

Show rate reveals problems that qualification rate hides

A lead can be genuinely qualified, a real fit, real budget, real timeline, and still not show up if the booking experience itself was weak: a vague confirmation, no reminder, or a scheduling process that felt like an afterthought. This is why show rate has to be tracked as its own number rather than assumed to follow automatically from good qualification.

Low show rates often point to problems in the booking and confirmation process rather than in who is being qualified, which is a useful distinction to make before assuming the issue is lead quality when it might actually be logistics.

Turning the numbers into action

The point of tracking all four is not to produce a report, it is to know where to intervene. A strong response time paired with a weak qualification rate points to a setting problem, not a speed problem. A strong qualification rate paired with a weak show rate points to a booking and reminder problem, not a lead quality problem. Treating a downstream symptom as if it were the root cause wastes effort fixing the wrong stage of the process.

Booked-to-close closes the loop back to revenue

The first three metrics all measure the setting process itself. Booked-to-close is what connects that process back to whether the business is actually making money from it. A setter can excel at speed, qualification, and show rate and still not be worth the cost if the appointments booked rarely convert once a salesperson takes over, which usually points to a mismatch between what the setter considers qualified and what actually closes.

This is also the metric most likely to reveal a disconnect between sales and setting, if either operates separately from the other. Reviewing booked-to-close regularly, and feeding what closes and what does not back into the qualification criteria, keeps the whole system tuned toward outcomes that matter rather than activity that looks productive.

Comparing periods, not just snapshots

A single week's numbers are noisy, especially for a smaller business without a high lead volume. These four metrics are far more useful compared over rolling periods, month over month or quarter over quarter, where a real shift in any one of them is more likely to reflect an actual change in the process rather than a random cluster of unusually good or bad leads.