Custom answers to Avatar

I am creating an interactive avatar for my website. I am using the OPEN AI to generate answers based on user's input. But the interactive avatar speaks some text and then repeats the one I provide.

Is there any way to restrict the Avatar not to speak anything until avatar.current.speak() function is used.