New METAHUMANS are TOO REALISTIC in UNREAL ENGINE 5.2

New METAHUMANS are TOO REALISTIC in UNREAL ENGINE 5.2

Introduction

The speaker introduces the use of machine learning to compress simulation data into a format that can be evaluated at runtime. They also introduce the MetaHuman Creator and demonstrate its capabilities.

Machine Learning for Real-Time Evaluation

  • Machine learning is used to compress simulation data into a format that can be evaluated in real-time.
  • Flash and class emotion from Houdini are running in real-time on PS5, taking around one-tenth of a millisecond on CPU for network inference and around one millisecond on GPU for morph targets evaluation.
  • A nearest neighbor model with just the PCA layer active is compared to an additional nearest neighbor set that improves fold reconstruction.
  • A k-means pose generator helps generate the optimal set of nearest neighbor poses by simulating clothing for these additional poses in Houdini.

MetaHuman Creator

  • The guiding vision for MetaHuman Creator has been the democratization of complex character technologies, allowing users to work faster and see results immediately.
  • Animating at this level is difficult even for skilled studios, but MetaHuman Creator gives users the ability to generate high-quality characters.
  • The speaker announces a new capability called MetaHuman Animator, which contains the essence of their 4D pipeline optimized to run on a single machine.

MetaHuman Animator

The speaker demonstrates how MetaHuman Animator works using performance capture technology.

Performance Capture Technology

  • Performance capture technology needs to work like a mirror, capturing facial expressions accurately.
  • Live Link Face Mobile app captures all data at the best resolution possible with the device.
  • MetaHuman Animator uses video and dev data to convert this data into high-fidelity performance animation, even using audio to produce convincing tongue animation.
  • The custom Epic facial solver and landmark detector can interactively look at the innovation while it's being solved and compared to the original performance.

MetaHuman DNA

  • From only three frames of video and that data, a rig can be generated that predicts all of your facial expressions in just a couple of minutes.
  • The calibration process is done once for each actor, which calibrates the solver to their face so that they can produce the performance in a way that faithfully reproduces their original performance.

Introduction

The speakers introduce the topic of performance capture and how it is used to create animations. They also mention a new technology called MetaHuman Animator that will be released soon.

  • Performance capture needs to work like a mirror to capture emotions accurately.
  • MetaHuman Animator is a new technology that can process animations quickly.
  • The technology uses a bespoke 4D rig created with Ninja Theory's help.

Full Performance Capture Shoots

The speakers demonstrate how MetaHuman Animator can process full performance capture shoots in minutes.

  • A clip from Senua Saga Hellblade 2 is shown as an example of unpolished animation processed by MetaHuman Animator.
  • The technology has the potential to redefine the creative process for animators.

Demonstration of Animation

A demonstration of an animation created using MetaHuman Animator is shown.

  • The animation features a character saying "I see through your lies. I will show them how to see, spider" and "I will not appease your gods. I will destroy them."
  • The speaker asks if the audience likes it.

Conclusion

The transcript ends abruptly after the demonstration, so there are no concluding remarks or final thoughts provided by the speakers.

Turn any video into a summary like this

YouTube links, meetings, lectures. With transcripts, search, and chat.

Video description

Unreal Engine 5.2 ML Deformer can be utilized to achieve lifelike deformation on your own real-time characters. It shows an approximation to a full muscle sim that takes 1 minute per frame normally. Also does cloth approximation. The footage included in this video is running live on PS5. 00:00 Metahuman Deformation on real time characters 01:42 New Metahuman Animator #ue5 #unrealengine #unrealengine5 *** ☑️ Please support the channel with a LIKE... and turn on notifications! 🔔 ❤️ SUBSCRIBE TO ENFANT TERRIBLE: https://www.youtube.com/channel/UCX1sraLIy6wS2R-SMcdoakg?sub_confirmation=1 *Disclaimer: If you're a publisher or developer and would like to get your game or asset featured in the channel, please contact us. We would love to feature your work and help you promote your game! Contact: contact [at] enfant-terrible [dot] media