Phonely, in partnership with Maitai and Groq, has tackled a major hurdle in conversational AI: the frustrating response delays that make interactions feel robotic.
The collaboration slashed response times by over 70% and pushed accuracy to 99.2%, surpassing GPT-4o’s benchmark of 94.7%. Groq’s tech allows for quick switching between specialized AI models, minimizing latency, while Maitai optimizes performance in real time.
This leap addresses the “uncanny valley” of voice AI—where automated conversations seem awkward. Phonely’s clients are already feeling the impact: one call center is replacing 350 human agents this month alone.
Traditional models like GPT-4o often face a “four-second problem,” where slight delays signal to callers they’re talking to a machine. Will Bodewes, Phonely’s CEO, pointed out that four seconds in voice interactions feels like an eternity.
“This kind of latency is unacceptable for real-time phone support,” said Bodewes.
Groq’s “zero-latency LoRA hotswapping” allows dynamic adjustments without performance hits. It means MAitai can optimize model selections seamlessly.
Performance statistics show substantial improvements. Time to first response fell from 661 milliseconds to 176 milliseconds, while overall completion times went from 1,446 milliseconds to 339 milliseconds.
“We’ve been seeing about 70%+ of people who call into our AI not being able to distinguish the difference between a person,” Bodewes noted.
These advancements translate to real business benefits. A major client using Phonely reported a 32% increase in qualified leads compared to older models.
Call centers are eager for change. The demand for efficiency, reduced costs, and better service is pressing. With Phonely, they can ditch human agents and focus on automation.
“Call centers are really seeing huge benefits from using Phonely,” Bodewes commented.
Groq’s specialized chips—Language Processing Units (LPUs)—enable this multi-model approach. They excel in language processing tasks, offering speed without the usual latency bottlenecks.
Maitai promises rapid deployment. Companies can transition to its optimized solutions within the same day, ensuring no disruption.
“For companies already in production… we can deliver a fine-tuned model that’s faster and more reliable than their original setup,” said Christian DalSanto, Maitai’s founder.
This partnership marks a significant shift in enterprise AI. Moving towards specialized models, companies are recognizing the limitations of one-size-fits-all systems.
As Phonely pushes forward with groundbreaking improvements, the competitive landscape in AI customer support is set for a major turnaround, potentially redefining expectations for automated interactions.