The main goal of this thesis will be to create a realistic virtual agent (digital character) which will be capable of voice communication with a user. The realistic appearance will be achieved via Unreal MetaHuman creator. The character models from this tool are prepared for full-body animation, facial emotions and lip-sync. The lip-sync will be used to synchronize the animation with the synthetized voice. Additionally, NVIDIA Riva and Rasa frameworks will be integrated into Unreal Engine to achieve intelligent answers, voice response and natural language processing. The aim is to reach a high realism of the created digital character in terms of visual, communicational and animation aspects. The agent information will be updated to enable situational awareness.
The student will create an Unreal Engine project with realistic MetaHuman character from Unreal MetaHuman Creator. NVIDIA Riva and Rasa frameworks will need to be set up for conversation with a user. These frameworks will then be integrated by the student into Unreal Engine and synthesized voice will be connected with the facial animation of the character. Finally, realistic human-body animation will be applied to increase the realism.
- Knowledge of C++ is advantageous
- Previous experience with game engines is welcome
The project will be implemented in Unreal Engine or Unity3D