AI Agent Starting Conversations Mid-Call: Shared Experiences Needed

I feel like the last few tests I've done, the AI agent starts talking on when it starts the call, not when sometime answers as I've answered and it was mid conversation. Anyone else experience this?