Discussions

Ask a Question
Back to All

All StreamingEvents not triggered on using custom userAudioWebsocketPath

I have followed the below two repos as mentioned in the Interactive Avatar Realtime documentation (http://docs.heygen.com/reference/heygen-interactive-avatar-realtime-api).

NextJS Demo
https://github.com/HeyGen-Official/InteractiveAvatarNextJSDemo/tree/realtime-alpha-demo
Pipecat Demo
https://github.com/HeyGen-Official/pipecat-realtime-demo

I am able to run the demo, but on using our own userAudioWebsocketPath, only AVATAR_START_TALKING and AVATAR_STOP_TALKING StreamingEvents are triggered, but I also want AVATAR_TALKING_MESSAGE and USER_TALKING_MESSAGE event to be triggered so that I can create a transcript of the realtime conversation at UI end.

I also found that if we don't use our own userAudioWebsocketPath all registered events get triggered as expected.

I think this could be happening because the realtime endpoint (https://docs.heygen.com/reference/heygen-interactive-avatar-realtime-api#client-events-events-you-send) has no event for talking messages.

Please let me know whether there's any way to get a realtime conversation transcript or not.

Thanks