Artificial Intelligence Breaks New Ground in Gaming: NVIDIA's Avatar Cloud Engine (ACE)

[FurkanGozukara]

Artificial Intelligence Breaks New Ground in Gaming: NVIDIA's Avatar Cloud Engine (ACE)

Full tutorial: https://www.youtube.com/watch?v=jMk5RHq8N1g

🎮 Are we on the brink of a gaming revolution? With the recent unveiling of NVIDIA's ACE (Avatar Cloud Engine), the horizon of gaming appears to be expanding exponentially. This video dissects the capabilities of this pioneering AI engine, demonstrating its prowess in speech recognition, text-to-speech, and natural language understanding through a monumental language model.

If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on 🥰 ⤵️

https://www.patreon.com/SECourses

Technology & Science: News, Tips, Tutorials, Tricks, Best Applications, Guides, Reviews ⤵️

https://www.youtube.com/playlist?list=PL_pbwdIyffsnkay6X91BWb9rrfLATUMr3

Playlist of StableDiffusion Tutorials, Automatic1111 and Google Colab Guides, DreamBooth, Textual Inversion / Embedding, LoRA, AI Upscaling, Pix2Pix, Img2Img ⤵️

https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3

Video Footage Source (NVIDIA Keynote at COMPUTEX 2023) ⤵️

https://www.youtube.com/live/QSWzSRnGEFo

🔥 Prepare to be mesmerized as we explore a completely AI-rendered scene, designed in the celebrated Unreal Engine 5. Observe the intricate lighting effects achieved through multiple sources and marvel at the realistic global illumination, which creates astoundingly beautiful shadows.

✨ In a groundbreaking collaboration, NVIDIA has partnered with Framework and avatar tool maker Comm AI. They've managed to orchestrate a spectacular demo featuring Jin, an AI character with a compelling backstory. The riveting narrative takes us through Jin's experiences as a ramen shop owner in a crime-ridden city, offering an unprecedented level of interaction and immersion.

⚡ The highlight? Every conversation occurs in real-time without a pre-set script! The AI-infused characters respond realistically to your interactions, creating a truly immersive gaming experience. All facial animations, gestures, and domain knowledge are autonomously generated by the AI, ensuring that no two gaming experiences are identical.

🌐 This video offers a tantalizing glimpse into the future of video games, where AI goes beyond rendering and synthesis of environments, playing a pivotal role in character animation. Step into a new world of gaming, where artificial intelligence is the architect of dynamic, immersive, and hyper-realistic experiences!

#NVIDIA #Computex2023 #UnrealEngine5 #AIinGaming #AvatarCloudEngine #CommAI #NextGenGaming #AIanimation #AIrendering #DigitalAvatars #GamingRevolution

Video Transcription

• 00:00:00 We used AI to render this scene. We're  gonna also use AI to bring it alive. 

• 00:00:06 Today we're announcing NVIDIA ACE  avatar cloud engine that is designed for 

• 00:00:14 animating to bringing a digital avatar  to life. It has several characteristics, 

• 00:00:19 several capabilities, speech recognition,  text-to-speech, natural language 

• 00:00:23 understanding, basically a large language  model, and using the sound that you will 

• 00:00:29 be generating with your voice animate  the face, and using the sound and the 

• 00:00:35 expression that you're saying animate  your gestures. All of this is completely 

• 00:00:40 trained by AI. Let's take a look at this  scene in just a second, but let me first 

• 00:00:45 tell you about it. It is completely  rendered with ray tracing. Notice the 

• 00:00:50 beautiful lights, so many different  lights, and all of the different lights 

• 00:00:54 are projecting light from that source, so  you have all kinds of direct lights. You 

• 00:00:59 have global illumination. You're gonna  see incredibly beautiful shadows and 

• 00:01:05 physics simulation, and notice the  character, the beautiful rendering of the 

• 00:01:09 character. Everything is done in Unreal  Engine 5. We partnered with framework and 

• 00:01:13 avatar tool maker called Comm AI,  

• 00:01:17 and together we developed this demo you're about to see. Okay, run please. 

• 00:01:41 Hey, Jin. How are you? Unfortunately, not  so good. How come? I am worried about the 

• 00:01:47 crime around here. It's gotten bad  lately. My ramen shop got caught in the 

• 00:01:52 crossfire. Can I help? If you want to do  something about this, I have heard rumors 

• 00:01:58 that the powerful crime lord Kuman Aoki  is causing all sorts of chaos in the 

• 00:02:02 city. He may be the root of this  violence. I'll talk to him. Where can I 

• 00:02:07 find him? I have heard he hangs out  in the underground fight clubs on the 

• 00:02:11 city's east side. Try there.  Okay, I'll go. Be careful, Kai. 

• 00:02:21 None of that conversation was scripted.  We gave that AI, this Jin AI character, a 

• 00:02:29 backstory. His story about his ramen  shop and the story of this game. 

• 00:02:36 And all you have to do is go up and  talk to this character, and because this 

• 00:02:40 character has been infused with  artificial intelligence and large 

• 00:02:44 language models, it can interact with  you, understand your meaning, and interact 

• 00:02:47 with you in a really reasonable way. All  of the facial animation completely done 

• 00:02:51 by the AI. We have made it possible for  all kinds of characters to be generated. 

• 00:02:56 They're all domain. They have their own  domain knowledge. You can customize it so 

• 00:03:01 everybody's games different. And look  how wonderfully beautiful they are and 

• 00:03:05 natural they are. This is the future of  video games. Not only will AI contribute 

• 00:03:10 to the rendering and the synthesis of  the environment, AI will also animate the 

• 00:03:15 characters. AI will be a very big  part of the future of video games.