Tuesday, September 27

AI propels Metaphysic to ‘America’s Got Talent’ finale

Over 6 million pairs of eyes will be on real-time AI avatar technology in this week’s finale of America’s Got Talent – currently the second most popular primetime TV show in the United States.

Metaphysic, a member of global tech startup network NVIDIA Inception, is one of 11 artists in the running for $1 million and a headliner in AGTof Las Vegas in tonight’s finale on NBC. This is the first AI act to achieve a AGT finals.

Called “the best act on the show so far” and “one of the most unique things we’ve ever seen on this show” by notoriously tough judge Simon Cowell, the team’s performances involve a display of… photorealistic AI avatars, animated in real time by singers on stage.

In the semi-final act of Metaphysic, three singers – Daniel Emmet, Patrick Dailey and John Riesen – lent their voices to Cowell’s AI avatars, fellow judge Howie Mandel and host Terry Crews, performing the piece. of opera “Nessun Dorma”. For the finale, the team plans to “bring back one of rock and roll’s greatest icons of all time,” but that’s left for the public to guess.

The AGT the winner will be announced on Wednesday, September 14.

“The historical course of metaphysics on America’s Got Talent allowed us to showcase the application of AI on one of the most watched stages in the world,” said startup co-founder and CEO Tom Graham, who appears on the show alongside co -founder Chris Umé.

(Left to right): Daniel Emmet, Tom Graham and Chris Umé introduced Metaphysic’s audition for “America’s Got Talent.” (Photo by Trae Patton/NBC, courtesy of Metaphysic.)

“While the general awareness of synthetic media has increased in recent years, the team at Metaphysic AGT the performances provide a front-row seat to understanding how this technology could impact the future of everything from the internet to entertainment to education,” he said.

Capturing the imagination while raising awareness of AI

Founded in 2021, London-based Metaphysic develops artificial intelligence technologies to help creators create virtual identities and hyper-realistic synthetic content, reaching beyond the so-called Odd Valley.

The team initially went viral last year for DeepTomCruise, a TikTok channel featuring videos where actor Miles Fisher animated an AI avatar of Tom Cruise. The posts garnered around 100 million views and “provided many people with their first introduction to the incredible capabilities of synthetic media,” Graham said.

By bringing their AI avatars to the AGT stage, the company was able to reach millions of additional viewers – with sophisticated camera rigs and performers on stage demonstrating how the technology works live and in real time.

AI, GPU acceleration behind the curtain

Metaphysic’s AI avatar software pipeline includes variants of the popular StyleGAN model developed by NVIDIA Research. The team, which uses the TensorFlow deep learning framework, relies on NVIDIA CUDA software to accelerate their work on NVIDIA GPUs.

“Without the NVIDIA hardware and software libraries, we wouldn’t be able to achieve these hyper-realistic results at the level we have,” said Jo Plaete, director of product innovation at Metaphysic. “The computation provided by our NVIDIA hardware platforms allows us to train larger, more complex models at a speed that allows us to iterate them quickly, yielding the most fine-tuned results.”

For AI model development and inference during live performance, Metaphysic uses NVIDIA DGX systems as well as other workstation and data center setups with NVIDIA GPUs, including NVIDIA A100 Tensor GPUs Core.

“The excellent hardware support helped us resolve issues very quickly when needed,” Plaete said. “And having access to research and engineering teams helps us better understand the tools and how we can leverage them in our pipelines.”

Next AGT, Metaphysic plans to pursue several collaborations in the entertainment industry. The company has also launched a consumer-facing platform called Every Everyone, which allows users to create their own hyper-realistic AI avatars.

Learn about the latest AI and metaverse technologies by registering for free at NVIDIA GTC, online September 19-22. Metaphysic will be part of the “AI for VCs: NVIDIA Inception Global Startup Showcase” panel.

Header photo by Chris Haston/NBC, courtesy of Metaphysics