When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
Advanced Voice Mode lets users engage in spoken conversations with the AIchatbot.
The idea is to make interactions more natural and accessible.
The AI has a few preset voices from which users can choose.
However, the system card reports that this feature has exhibited unexpected behavior under certain conditions.
During testing, a noisy input triggered the AI to mimic the voice of the user.
In the case of voice synthesis, this prompt relies on an authorized voice sample.
But, while the system prompt guides the AIs behavior, it is not foolproof.
you’re free to hear what happened in the clip below when the AI jumps in with No!
and suddenly sounds like the first speaker.
As OpenAI said, it has since implemented safeguards to prevent such occurrences.
That means using an output classifier designed to detect deviations from the pre-selected authorized voices.
This classifier acts as a safeguard, helping to ensure that the AI does not generate unauthorized audio.
The models outburst, where it suddenly exclaimed No!
