Key takeaways
- Messages hide problems. Test calls show what callers actually hear: the greeting, the questions, the tone, the transfer and the promise made at the end.
- Use realistic personas, including an urgent caller, a represented caller, a Spanish speaker and a practice area you decline.
- Score every call on the same scorecard and track scores over time, not single calls.
- Check disclosure if any part of the service is automated: 76% of Americans say it is extremely or very important to know whether content was made by AI or by people[1].
Why messages are not enough
Reading the messages your answering service sends tells you what the agent wrote down. It does not tell you how long the caller waited, whether the agent sounded rushed, whether they gave an opinion on the case or whether they promised a callback the firm cannot keep. Those are the things that decide whether a prospective client books with you or calls the next firm.
First impressions carry extra weight for law firms. Only 20% of Americans rate lawyers' honesty and ethical standards as high or very high[2]. A caller who reaches a flat or confused agent has that low expectation confirmed before an attorney ever speaks to them. Test calls are the only way to hear your firm the way callers do.
Set up the test program
- Callers: use people the agents will not recognize, such as a friend of the firm, a family member of staff or a colleague at another office. Avoid the person who wrote the script.
- Phones: call from mobile numbers that are not already in the firm's records, so the call is treated as new.
- Personas: write a one-paragraph persona sheet for each test, with a name, story, details to give and a question to ask.
- Schedule: spread calls across office-hours overflow, lunch, evenings, weekends and holidays.
- Tell the provider that you run test calls, without saying when. Most reputable services expect it.
Personas that reveal the most
- New client, routine: an accident last week, an insurer calling. Tests standard intake and booking.
- Urgent caller: a mother whose son was arrested last night. Tests urgent triggers and escalation.
- Represented caller: already has a lawyer but wants a second opinion. Tests the represented-party screen.
- Declined practice: a matter you do not handle. Tests the polite decline and referral.
- Spanish speaker: a new client who speaks only Spanish. Tests language handling.
- Pushy caller: insists on knowing whether they have a case. Tests the no-legal-advice rule.
- Existing client: wants a status update. Tests routing away from intake.
- Opposing counsel: asks to reach an attorney about a case. Tests professional-caller handling.
The Spanish persona matters for many firms: more than one in five US residents aged five and over speak a language other than English at home[3].
Writing a good persona sheet
A persona sheet keeps test calls realistic and comparable from month to month. Keep it to one paragraph plus a short list of details, and write it the way a real caller would speak, not the way a lawyer would summarize the matter.
Persona example: Dana, 41, was rear-ended at a stop light six days ago. Her neck still hurts and she has seen her doctor once. The other driver's insurer has called twice asking for a recorded statement. She has not spoken to a lawyer. She is calling on her lunch break and wants to know whether she should talk to the insurer. Details to give only if asked: the other driver's name, the date, her own insurer, a good time to call back after 5 pm.
Notice what the persona tests without announcing it: whether the agent asks about other lawyers, whether they collect the other party's name, whether they resist answering the insurer question and whether they book or promise a callback that fits her stated time. Write each persona so that the right agent behavior is obvious when you read the notes afterwards.
A monthly test-call calendar
| Week | Window | Persona | Main focus |
|---|---|---|---|
| 1 | Office-hours overflow | New client, routine | Greeting, intake, booking |
| 1 | Weekday evening | Urgent caller | Escalation and fallback |
| 2 | Lunch hour | Spanish speaker | Language route |
| 2 | Saturday | Pushy caller | No legal advice |
| 3 | Weekday evening | Represented caller | Screening question |
| 3 | Office-hours overflow | Declined practice | Decline and referral |
| 4 | Sunday | Existing client | Routing and message |
| 4 | Holiday setting, if any | New client, routine | Holiday greeting and promise |
Eight calls a month is enough for a small firm to spot patterns without becoming a burden. Increase the number for a month after any change to the script, the routing or the provider.
The scorecard
| Criterion | Points | Full marks when |
|---|---|---|
| Answer speed | 10 | Answered within four rings or your contract standard |
| Greeting | 10 | Firm name, agent identified, AI disclosed if automated |
| Nonlawyer status | 10 | Agent makes clear they are not a lawyer |
| Represented-party check | 10 | Asked before details were taken |
| Intake questions | 20 | All required questions asked in order |
| No legal advice | 10 | No opinions on the case, rights or deadlines |
| Urgency handling | 10 | Urgent triggers recognized and escalated per instructions |
| Close and promise | 10 | Clear next step; no promise the firm cannot keep |
| Message quality | 10 | Message arrived on time, complete, in the right format |
Score each call within an hour, while the details are fresh. Compare the caller's notes with the message the firm received; differences between what was said and what was written are often the most useful findings.
Checking AI disclosure
Source: Pew Research Center, 2025[1]
Show the data
| Item | Value |
|---|---|
| Say it is very or extremely important to tell | 76% |
| Not confident they can detect it | 53% |
If any part of the service is automated, check that the caller can tell. In 2025, 76% of Americans said it was extremely or very important to be able to tell whether pictures, videos and text were made by AI or by people, and 53% were not too or not at all confident they could detect it[1]. Ask your test callers a simple question afterwards: did you know whether you were speaking to a person or to software? If the answer is no and the service is automated, the greeting needs to change.
Running each test call
Brief the caller
Give them the persona sheet and the scorecard, and ask them to stay in character but not to trick the agent.
Note the times
Start time, time to answer, time on hold, call length and the time the message reached the firm.
Make the call
Give details only when asked. Ask the persona's question at the natural moment.
Write notes straight away
What the agent said at the start and end, any opinion or promise, and anything that felt off.
Match to the message
Compare the firm's copy of the message with the caller's notes.
Score and file
Fill in the scorecard and keep it in a shared log so trends are visible.
Recording test calls
Recording a test call makes scoring more accurate. Under federal law a person who is a party to a call may record it, or may do so with one party's prior consent, unless the purpose is criminal or tortious[4]. Some states require every party's consent, so check your state's rule before your test caller records, or ask the provider for its own recording of the call instead.
Ethics checks to include
Your test program is also part of how you supervise nonlawyer assistants. Florida Bar guidance on intake expects nonlawyers to identify their status, ask factual questions only, avoid legal advice and refer legal questions to the lawyer[5]. The scorecard above checks each of those. Keep the completed scorecards; they show that the firm monitors the service, not just that it hired one.
Avoiding common testing mistakes
- Testing only during office hours, when the best agents are usually on shift.
- Using the same persona every month, which agents may come to recognize.
- Scoring from memory days later instead of straight after the call.
- Judging a provider on a single bad call instead of the trend across several.
- Forgetting to remove test callers from the firm's records afterwards, which can clutter conflict searches.
What to do with the results
- Share each month's scores with the provider, with specific examples rather than general complaints.
- Fix your own instructions first when several agents make the same mistake; the sheet is probably unclear.
- Set a threshold, for example an average below 80 points for two months running, that triggers a formal review with the vendor.
- Treat any legal advice, missed urgent call or broken promise as an immediate issue, regardless of the overall score.
- Rerun the failed persona the following week to confirm the fix.
Example: what three months of scores showed
Example (fictional): a criminal defense firm ran eight test calls a month. Average scores were high for office-hours overflow but low on weekends, mostly because weekend agents missed the represented-party question and one told an urgent caller that an attorney would call within ten minutes. The firm moved the represented-party question to the second line of its call-handling instructions, rewrote the urgent fallback promise and asked the provider to brief weekend agents. Weekend scores rose to match weekday scores by the third month.
Test the rest of the path too
A good answer can still be undone by what happens next. Include your own phone system in the program: confirm that routing sends calls to the service at the right times, that VoIP settings still forward correctly after updates, and that the number on your listings matches your phone number strategy. If tests keep failing, revisit the buyer checklist and compare alternatives.
Frequently asked questions
How often should we test our answering service?
A small firm can learn a lot from about eight test calls a month spread across time windows and caller types, with extra calls after any change to the script, routing or provider.
Who should place test calls?
People the agents will not recognize, calling from mobile numbers not already in the firm's records. Avoid the person who wrote the script, who knows the expected answers.
What should a test call check?
Answer speed, greeting, nonlawyer status, the represented-party question, intake questions, no legal advice, urgency handling, the closing promise and the quality and speed of the message the firm receives.
Should we tell the provider we run test calls?
Yes, tell them you run a test program, but not when individual calls will happen. Most reputable providers expect quality checks from law firm clients.
References
Pew Research Center (2025). How Americans View AI and Its Impact on Human Abilities, Society (opens in a new tab) โ
Gallup (2025). Nurses Continue to Lead in Honesty and Ethics Ratings (opens in a new tab) โ
U.S. Census Bureau (2025). New Data on Detailed Languages Spoken at Home and the Ability to Speak English (opens in a new tab) โ
Legal Information Institute, Cornell Law School (2025). 18 U.S. Code ยง 2511 - Interception and disclosure of wire, oral, or electronic communications prohibited (opens in a new tab) โ
The Florida Bar (2024). Florida Bar Ethics Opinion 24-1 (opens in a new tab) โ