Brief, mostly facts
Speculative tool calling cuts voice agent latency
Tool lookups start once key details are spoken, not after the caller finishes. SHANKS completed 56.9% of tool calls before turn end.
What the research found
Tazo Labs explains speculative tool calling, which starts CRM or order lookups once the key info is spoken rather than after the caller finishes, citing SHANKS completing 56.9% of tool calls before turn end.
Claims and how well the evidence supports them
- Speculative tool calling starts lookups while the caller is still speaking 99%
- SHANKS model completed 56.9% of tool calls before the user finished their turn 99%
- Twilio sets a mouth-to-ear target of 1,115 ms 99%
Evidence
- tazolabs.com https://tazolabs.com/blog/speculative-tool-calling-voice-ai
- news.ycombinator.com https://news.ycombinator.com/item?id=50069985
Actionability rated medium.