Mixed Reality and AI – our digital human assistant powered by GPT4

When AI and AR/MR meet joyously

So many people have asked us what the intersection between Artificial Intelligence (AI) and Mixed Reality (MR) is. Instead of explaining it, we thought we would build something to actually demonstrate how these two technologies can shine in combination.

We have been experimenting with our “AI human”, aka an embodied conversational agent (ECA), for a while. Powered by GPT4, it is ready to flourish in various industries and environments by providing a more natural and intuitive way of engaging with massive amounts of knowledge. It can serve an array of use cases, most obviously as an assistant to answer questions on every or any specific topic. It may resemble a historical figure or other character or person using a customized voice to tell unique stories in a style and language of your choice. The possibilities are endless.

On mobile or mixed reality headset

Our AI assistant runs on mobile (smartphones and tablets) for use cases addressing large audiences. Simply tap the record button on the screen and start talking to the 3D avatar in front of you. The most immersive and “real” experience is of course achieved by wearing a mixed reality headset. In this case, the 3D being interacts with you in full human size, face to face, see video below.

“Tell me some interesting facts about the Wings For Live Worldrun!”

We have been big fans and supporters of the Red Bull’s annual running event for many years. And as the big day is approaching fast again on May 5th, 2024 we thought we would ask our AI assistant some questions about the race.

AI Assistant answering questions on the Wings for Life Worldrun by Red Bull

Sign up to run for those who can’t on here: https://www.wingsforlifeworldrun.com

More videos and use cases