Digital Humans

A chatbot can act like a pirate for three turns. That is not the impressive part. A teenager with a Halloween hat can also do that. The harder problem begins when the agent has to remember what happened last week, preserve a recognizable personality across changing situations, make choices consistent with its motives, avoid borrowing another character’s copyrighted voice a little too enthusiastically, and still behave safely when the user pushes it outside the script. At that point, “pretend you are X” stops being a prompt trick and becomes a systems engineering problem. ...

Avatars are easy to make expressive once. That is the boring version of the problem. Give a motion model enough examples of sad walking, angry gesturing, or excited dancing, and it can learn the broad association between text and motion. The harder problem starts later, after the product has already shipped. A game studio adds a new combat animation pack. A VR training company expands from office scenarios to emergency response. A digital-human platform moves from daily-life gestures into sports, performance, musical instruments, and acrobatics. Suddenly “sad” is no longer just a lowered head during walking. It must become a lowered head while jogging, a constrained body during performance, or a professional movement pattern inside a sport. ...

TL;DR for operators OmniAvatar is best read as a shift from “make the mouth move” to “make the person perform.” The paper introduces an audio-driven avatar video generation system that takes a reference image, an audio clip, and a text prompt, then generates facial and semi-body video with synchronised speech, adaptive body motion, and prompt-controlled scene elements.1 ...