Discussions

Ask a Question
Back to All

Interactive Avatar with Unity WebRTC and Streaming API from HeyGen

Hi all!

I'm trying to use the Streaming API with Unity.

I managed to do everything, I'm also sending tasks to the default avatar (I've never created one).

Unfortunately I can't understand how video and audio works.

I tryed to subscribe to the Unity WebRTC event OnStream, I attached a RawImage and Blit on this image everything from the OnStream, something is working because I can see a white rectangle inside the RawImage but it seems like only one frame is received. Also if I send a task after I received the frist frame of video it seems nothing is happening.

About the audio I've no idea on how to implement this with Unity WebRTC.

Can someone give me some hints?

Do I need to do something else more than I already did? Do I need to create a video also if I'm using an interactive avatar? Maybe I misuderstood something of the workflow?


Thaks in advance for the help!