Preview Omniverse Audio2Face

Preview Omniverse Audio2Face

Preview Omniverse Audio2Face

“Omniverse Audio2Face App is based on an original NVIDIA Research paper. Audio2Face is preloaded with “Digital Mark”— a 3D character model that can be animated with your audio track, so getting started is simple. Just select your audio and upload it into the app.  The technology feeds the audio input into a pre-trained Deep Neural Network and the output of the network drives the facial animation of your character in real-time.  Users have the option to edit various post-processing parameters to edit the performance of the character. The output of the network then drives the 3D vertices of your character mesh to create the facial animation. The results you see on this page are mostly raw outputs from Audio2Face with little to no post-processing parameters edited…”

Source: www.nvidia.com/en-us/design-visualization/omniverse/audio2face/

Subscribe to our Digest