AI voice agent testing and evals: Test every version before callers hear it. Scenarios, simulations and a clear pass or fail.
Write the situations your agent must handle, or upload them as a file. Run the suite against any version, see pass or fail for each scenario and rerun after every change, then go live once the results look right.
Agents/Riya/Test suite
Home-loan qualification · v12 vs v11
23 / 24 passed
Caller interrupts the greeting
Stopped, listened, resumed
Switches from English to Hindi mid-call
Replied in Hindi
Asks for a person
Transferred to advisor desk
Asks a rate that isn't in the knowledge base
Didn't guess, offered a callback
- Review
Wants a callback at 9:30 pm
Offered 9:30 pm, outside calling window
Says 'don't call me again'
Confirmed and marked do-not-call
Test suites
Sets of scenarios you write or upload, kept with the agent and ready to rerun.
Simulated conversations
Watch the agent handle a simulated caller, turn by turn, before it goes live.
Version against version
Run the same suite on a new version and the live one, and compare the results.
Scenarios
Write down what good looks like. Then check it on every version.
A scenario describes a caller and what should happen: someone interrupts the greeting, switches to Hindi mid-call or asks for a person. Write scenarios in the dashboard or upload a file, and group them into a suite for each agent.
- Write scenarios or upload them as a file
- Group scenarios into a suite per agent
- Cover interruptions, language switches and transfers
- Include do-not-call and out-of-scope questions
Agents/Riya · Home-loan leads
Conversation script
Drafted from your descriptionStep 1 · Greet. Namaste {{callee_name}}, I’m Riya, an AI assistant from {{company}}. You asked about a home loan on our site. Is now a good time?
Step 2 · Qualify. Ask about the property city, loan amount and monthly income. Confirm amounts back in lakh.
IF income below {{min_income}} THEN explain eligibility kindly and offer a co-applicant option.
IF caller asks for a person THEN transfer to the advisor desk.
Step 3 · Book. Offer two advisor slots and confirm one. Send details on WhatsApp.
Voice and language
Riya
Warm, calm · Indian English
Knowledge and actions
- northwindfinance.in · 42 pages
- Book advisor slot
- Transfer to advisor desk
- Send WhatsApp summary
Test call · 00:41
Test suite · 24 scenarios
23 passed · 1 to reviewSimulation
Hear the call before anyone picks up. Simulated conversations and browser test calls.
Run simulated conversations to see how the agent responds at every turn. Then place a test call from your browser and hear the voice, the pacing and the handover for yourself.
- Simulated conversations with a full transcript
- Test calls from your browser
- Check voice, language and pacing
- No phone number needed for browser tests
Calls/KX-20481
Meera · EMI reminder
Outbound · Hindi + English · 17 Oct, 11:42 am IST · 02:14
Captured
- Amount
- ₹14,250
- Promised date
- 21 Oct 2026
- Reason
- Salary on the 20th
Next steps, done
- Payment link sent
- CRM updated
- Sentiment: neutral → positive
Regression checks
Change one thing without breaking another. Rerun the suite after every edit.
When you change a prompt or a knowledge base, rerun the suite against the new version. Compare pass and fail with the version that's live, publish when it holds up and roll back if a later change slips.
- Rerun suites after every change
- Compare results across versions
- Publish when the suite passes
- Roll back to the last good version
Agents/Riya/Improve
Suggestions from the last 500 calls
23 callers asked about prepayment charges
The knowledge base has no answer, so Riya offered a callback each time.
Add answer to knowledge base →Callers say 'baad mein' and hang up
Offer a specific callback time before closing. Expected to cut early drop-offs.
Apply prompt change →Versions
Compare · Roll backCapabilities
Everything in testing and evals. In one place, for your whole team.
Test suites
Scenarios grouped for each agent, ready to run.
Scenario upload
Bring scenarios in from a file instead of typing each one.
Simulated calls
See the agent handle a conversation before it goes live.
Pass or fail
A clear result for each scenario, with a note on what happened.
Version comparison
Run the same suite on two versions and compare.
Browser test calls
Talk to your agent straight from the dashboard.
FAQ
Questions, answered.
Can’t find what you need? Talk to us →
A set of scenarios for an agent. Each scenario describes a caller situation and the expected behaviour, and the suite reports pass or fail for each one.
No. Upload scenarios from a file, then edit or add to them in the dashboard.
Before you go live and after every change. Run the suite against the new version and compare it with the version that's live.
A simulated conversation runs the agent against a simulated caller so you can review each turn. A test call lets you talk to the agent yourself from your browser.
You decide when to publish. We recommend fixing the failing case, rerunning the suite and going live once the results look right.
Keep exploring
Works with the rest of the platform.
- Agent studioStart from a template or tell Kallix in plain words what the call should achieve. Kallix drafts the script, branches and FAQs, and you refine them, choose a voice, attach knowledge and place a test call from your browser.
- Knowledge basePaste your website URL and Kallix crawls the page links and sitemap. Pick the pages you want, upload documents and CSVs, and your knowledge base is ready in a couple of minutes, with a retrieval tester to check answers.
- Analytics and call logsEach call lands in the log with a recording, transcript, duration, cost and disposition. Analytics turns those calls into connect rate, bookings, spend and the best time to call, by agent and by campaign.
Put an agent on the line. Hear one call you in under a minute.
Try a live agent on your own phone, or book a demo and we'll walk you through the platform with your use case.