Discussions
Audio Latency Heygen Interactive Avatar SDK (WebRTC)
I'm currently running a custom web app that integrates the Heygen Interactive Avatar SDK (deployed via Vercel), used on an NVIDIA Shield Pro (Android TV). The avatar loads and responds as expected, but I’ve run into a specific issue with Bluetooth audio:
Whenever the avatar speaks in real-time (using WebRTC audio), there's a noticeable audio delay (latency) when the output goes through a Bluetooth speaker
It seems that Android TV triggers some internal buffering mode or possibly HFP profile behavior, even though these Bluetooth receivers have no microphone. The result is a consistent lipsync issue when using Heygen’s real-time voice on Bluetooth speakers.
My question is:
Is there a way to configure the Interactive Avatar SDK (or WebRTC/audio pipeline) to avoid this latency — for example by bypassing real-time audio buffering, or by allowing audio to be streamed in a way that’s compatible with Bluetooth A2DP on Android TV?
In many bluetooth systems we've observed, a variable latency is often introduced in the bluetooth hardware side. This is problem present in any bluetooth audio with synchronzied video source in general. In meantime, we've found hardwire connections to be most reliable. If you must use bluetooth, try using one the supports aptx low latency protocol.