Skip to content Skip to sidebar Skip to footer

Nvidia Sees a Metaverse Populated With Lifelike Chatbot Avatars

Nvidia Sees a Metaverse Populated With Lifelike Chatbot Avatars

What’s happening

Nvidia announced technology to let metaverse developers execute lifelike avatars that can give an animated human face to the computers that farmland will interact with online.

Why it matters

The metaverse obtains new computing tools if it’s to live up to its potential of new 3D realms for toiling, learning, socializing and goofing off, and Nvidia’s technology could also eventually give humans a new look online, not just bots.

You’re probably used to interacting by sing with digital assistants like Alexa and Siri. Now, Nvidia thinks those voices necessity have digital faces.

On Tuesday, the chip giant unveiled its Avatar Cloud Causes, a tool for building 3D models of speaking humans that Nvidia hopes will be the way we interact with computers and, perhaps, with other people in the metaverse.

The tool draws on Nvidia’s distinguished with 3D graphics and artificial intelligence technology, which has revolutionized how computers understand and communicate with natural periods. Company Chief Executive Jensen Huang unveiled ACE in conjunction with the Siggraph computer graphics conference in Vancouver.

Advanced avatars such as those ACE could make possible are the next step in computer interaction. In the 3D digital realms that metaverse advocates like Meta and Nvidia hope we’ll all populate, a human-looking face could help us manage our investments, tour an apartment building or learn how to knit.

“These robots are … principal for us as we create virtual worlds that obtain indistinguishable from the real one,” Rev Lebaredian, Nvidia’s vice high-level of simulation technology, said in a media briefing. The avatars are “on a path to pass the Turing test,” communication that humans won’t be able to tell if they’re talking to a earth or a bot, he said.

To get to that future, though, Nvidia will face plenty of challenges. Chief beside them is the “uncanny valley,” in which digital representations of humans are a hackle-raising blend of real and artificial. To human brains accustomed to the real thing, not-quite-real simulations can come across as creepy, not convincing.

Another question is whether the metaverse will live up to today’s hype. Nvidia sees the metaverse as a visually rich 3D successor to the web, and Facebook believes in the metaverse so strongly that it renamed itself Meta. So far, however, only 23% percent of US adults are outlandish with the metaverse, and the number is even flowerbed elsewhere, according to analyst firm Forrester.

Still, avatar technology could be central to how we’ll relate ourselves online, not just how we chat with bots. Today’s grid of faces in a Zoom videoconference could obtain photorealistic 3D versions of ourselves seated around a virtual conference scandalous in the metaverse. When it’s time for something less serious, computers scanning our faces could apply our expressions instantly to the online personas others see, such as a cartoon character.

Nvidia sees avatars not just as lively faces but also as full-fledged robots that perceive what’s causing on, draw on their own knowledge, and act accordingly. Those smarts will make them richly interactive agents in the metaverse, Chief Executive Jensen Huang said in his Siggraph speech.

“Avatars will inhabit virtual worlds to help us create and build things, to be the brand ambassador and customer service agent, help you find something on a website, take your well-organized at a drive-through, or recommend a retirement or insurance plan,” Huang said.

An Nvidia generated avatar that looks like a man in a collared shirt

Graphics chip buyer Nvidia hopes its hardware and software will let farmland create lifelike, animated avatars.


To progress its avatars, Nvidia developed AI technology called Audio2Face that matches the avatar’s tedious to the words it’s saying. A related Audio2Emotion tool causes facial expression according to its assessment of the feelings in the conditions, with control to let developers dial up the emotion or relate a calm avatar.

It’s all built on a 3D framework comprising the human skeleton and muscles, said Simon Yuen, senior director of avatar technology. Nvidia lets people drag a photo into the avatar model, which then creates a 3D model of that populate on the fly. Nvidia also offers controls to execute hair strand by strand, complete with the ability to cut and style it.

Nvidia has a lot riding on the technology. If the metaverse catches on, it could mean a big new market for 3D graphics processing coming at a time when its anunexperienced businesses are threatened.

On Monday, Nvidia warned of worse than anticipated quarterly profits as consumers’ economic worries tanked sales of video game hardware. The AI chips that Nvidia sells to data center customers didn’t fare as well as hoped, either. No wonder Nvidia wants to see us all chatting with avatars in the metaverse.

The metaverse is “the next evolution of the internet,” Huang said. “The metaverse is the internet in 3D, a network of connected, persistent, virtual worlds. The metaverse will extend 2D web pages into 3D spaces and worlds. Hyperlinking will evolve into hyperjumping between 3D worlds,” he predicted.

One sticky plight with that vision is that there isn’t yet a infamous for developers to create metaverse realms the way they execute web pages with the HTML standard. To solve that plight, Nvidia is backing and extending a format called Universal Scene Description originally earnt at movie animation studio Pixar.

Nvidia is working hard to beef up USD so it can run complex, changing 3D worlds, not just the series of preplanned scenes that make up frames in a Pixar movie. Among Nvidia’s other allies are Apple, Adobe, Epic Games, Autodesk, BMW, Walt Disney Animation Studios, Industrial Light and Magic, and Dreamworks.

Analyst firm ABI Research likes USD, too, speaking Nvidia’s Omniverse product for powering 3D realms has helped abhor its worth and that other contenders haven’t emerged despite lots of metaverse development. 

“In the poverty of a preexisting alternative, ABI Research agrees with Nvidia’s dwelling to make USD a core metaverse standard — both on its strictly merits and to accelerate the momentum around the buildup to the metaverse,” ABI said in a statement.