My AI Phone Assistant Failed—Until We Changed the Architecture
I said, “Hi, how are you?” About ten seconds later, my AI assistant queued its answer. Then I said the latency was a huge problem and asked how we could reduce it. That answer took about fourteen seconds to queue. The assistant had a sensible explanation. Unfortunately, I had to wait for it. At that point, this was the most functional call of the evening. I asked my assistant to draft a blog post about the failure. Failures deserve to be written up too, especially when the individual components appear to work but the result is something nobody wants to use. ...