Improving Portuguese Voice Recognition for AI Agents: Challenges & Solutions

Hi everyone, I hope you're doing well. I’m currently testing an agent that is fully configured to work in Portuguese — including the advanced prompt and expected inputs/outputs. The agent is correctly speaking in Portuguese, but it still struggles to understand spoken Portuguese consistently. For example, when the contact replies with “sim” (Portuguese for "yes", pronounced /sĩ/), the agent often fails to recognize it properly and doesn't proceed as expected — especially in basic confirmation steps like “Are you [contact.name]?”. Instead of interpreting “sim” as a confirmation, it either gives an error or repeats the question. I’ve tried different voice options — including Thoughtly native voices, Cartesia, ElevenLabs, and custom ones — but the problem remains. Is there any estimate or update on when agents will be able to reliably recognize and process speech exclusively in Portuguese? Or perhaps a recommended setup to improve Portuguese voice recognition? Thanks in advance for any guidance!