How to make Agent Know When user complete his response?

I am able to building custom HeyGen agent with my custom prompt. But I faced that when user response to agent, generally user take pause while talking but agent take it like user complete the response and response to user on half user response. which make integration less intactive and flow go unstructure. Also Agent don't have remembering capability while talking