Discussions

Hi Support,

I have done a demo with the interactive avatar demo project on github. However, after the demo, my client is asking for client-side function calling. This client of mine is the head of customer service, in-charge of a team of customer service officers. (1) The deployment will be on a self-help kisok, and if there are any complex questions that the users are not able to get out of the Heygen Interactive Avatar video, the kisok (with the Heygen Interactive Avatar) will then dispense a Queue number where the customer service officer will further assist the user. (2) In the Knowledge base in the Public Avatar section, I have customized around 9 pages (about 180 Q&As) FAQs. However, there are other knowledgebase that exists as eBooks. In this case, how can I further RAG the knowledgebase for interactive avatar support? Can someone look into these questions? I have checked out the GPT plugin, but that is meant for video creations only. There is nothing about the OpenAI Realtime API integration that can work together RAG and client side function calling.