Call variants and split tests
A variant is one way to make the call. Kata runs a few at once and gives more calls to the ones that work.
What a variant holds
| Part | What it is |
|---|---|
| Opener | What the caller says when they pick up. It decides whether people stay on the line. |
| Script | The goal, the points to make, the objections, the ask. Only facts from the brief. |
| Engine | grok or openai. See Voice engines. |
| Voice | A voice of that engine. |
Create or change one with set_call_variant; status: retired takes it out of the test. Read them with their stats through GET /api/call-variants or call_stats.
How the test runs
- 01
Each call picks a variant.
Thompson sampling: the better a variant has done, the more calls it gets, while the others still get some.
- 02
Success is counted on conversations.
A success is
interested,callbackor a conversion. Each variant shows its rate andp_best, its chance to be the best. - 03
Each hour, it evolves.
From 20 conversations on, the same rule as email angles: a variant with little chance to be the best is retired, and the AI writes a new script from the winner.
Change one thing at a time between two variants, the opener or the engine, to learn what works.