Discussions

How do I integrate an OpenAI Assistant with the HeyGen streaming avatar?

Hello everyone,

Hi Team ,
I can't find any documentation to impelement push to talk functionality ... is there an easy way to do this?
Thanks !

Hi HeyGen Team,

Looking at other discussions: a general situation.

I want to filter transcripted user voice input inside an event "USER_TALKING_MESSAGE". Is there any way, how to change text in "message.detail.message", or some method to change which text will be send for talking?
Or is there possibility to interrupt the avatar talking? I tried call {handleInterrupt}, but without success in any of these events ( USER_TALKING_MESSAGE, USER_END_MESSAGE, USER_START, USER_STOP, AVATAR_START_TALKING)

I am trying to change the avatar language after creating it, is there a possible way.

Would it be possible for me to trigger event listeners in JS based on the output of the interactive avatar?

const video = useCallback(async () => {
const options = {
method: "GET",
headers: { accept: "application/json", "x-api-key": apiKey },
};

I've noticed that initializing a StreamingAvatar session sometimes consumes 0.1 credits even when the avatar never speaks or performs any actions, while other times the same unused session shows 0 credit consumption.