Newsfilter article unlocker

I live for things like these Oh, oh, oh I live full, I live fully Oh, I love it I live like this Oh, we're sky high up here rolling And we won't turn around Yeah, we'll go our way up Ain't nobody can bring us down We turn up, we coming through We won't stop, no way we can't lose Yeah, here we are The American Pronunciation Guide Presents ''How to Pronounce Intelligence'' This is how intelligence is made. A new kind of factory. Generator of tokens. The building blocks of AI. Tokens have opened a new frontier, turning data into knowledge, and knowledge into action. They decipher nature's code to reveal hidden cures, mirror our cities, and tirelessly navigate our world to keep us moving. Tokens learn from the way we move. Deliver the care we need. we walk into danger. To protect the ones we love, they see what we cannot. So the steadiest hands never work alone. Every idea tokens spark. Every success they share, Puts what matters within reach. Tokens are helping us break new ground. On a scale never seen before. so we can reach for the sky and beyond. Together, we take the next great leap into a bright new future. Built for all mankind. And here is where it all begins. Welcome to the stage, NVIDIA founder and CEO, Jensen Wong. Hello, Berlin! Hello, Berlin! Welcome to GTC. It's great to be here. Before we start, let's give it up for our pregame show hosts. smart and adorable smart and adorable they spoke about AI infrastructure sovereign AI AI safety and physical AI they covered enormous amount of ground this morning and we are going to take it one step further it's really interesting What do L'Oreal, Revolut, Spotify, Merck, Vodafone, Zara, Porsche, Nestle, and HSBC have in common? Well, they're all European companies, and they're all working with NVIDIA on AI. Everybody, everybody here is all activated on the AI ecosystem and working towards the AI economy. We've been working here in Europe now for 33 years. You probably don't realize that NV1, NVIDIA's first chip, NV2 and NV3, which became Revo 128, the chip that saved our company really and launched our company, were all built in Europe. Our first partner was SGS Thompson. We manufactured a chip in Kroll, France, assembled it in Malta, and shipped it around the world. Our first largest customer, the largest customer of GeForce days in the beginning, was a company called MediaMark. Do you know them? media media mark had a spectacular idea about building pcs as you remember and they were our largest customer it was elsa a german company that brought nvidia into the workstation industry in the year 2000 now nvidia is in every single workstation all over europe designing cars Everything from styling, design, engineering, simulation, all the way through to even inside the car, which a European company brought us into, Audi, in the year 2005. Then in year 2020, we started working on autonomous vehicles with Mercedes. As you could see, NVIDIA's life journey the entire 33 years, I've spent a lot of time in Germany. So I'm delighted to be back. Thank you. I'm delighted to do GTC here. This year, this last year, we started the new journey to building a new industry here in Europe. The beginnings of the AI economy. In the last year alone, we've invested nearly $10 billion in Europe across startups, big partnerships, small partnerships all over Europe. This last week alone, as I journeyed from France and UK to Sweden and now here in Berlin, we announced the investments of 14 startup companies. Overall, since the beginning, we now have 12,000 plus partnerships across Europe, and we're all working towards one goal now. After decades, after decades of advancement in the computer industry, we are now at the beginnings of a new industrial revolution. This image was generated by a computer. It was prompted by me. Nice, simple prompt about AI powering a new industrial revolution generated this. I gave it a few partners that I wanted to highlight, companies that we're working with and this is an extraordinary thing in the mind of the ai this is what it means to build a new industry generation of tokens the produce production of intelligence which integrates into every single industry powering a new industrial revolution A new industrial revolution happens when the new technology affects how we build something and what we can build. How we build Something and what We can build I think in every single way Artificial intelligence will affect everything we build and in fact enable us to build new things in this way because everyone will use it. Every company will be powered by it because it's digital intelligence, the foundation of everything. Every single person will use it, every company will powered by, it every industry will be transformed and new ones will be created. In this way, like the electricity, it is a new Industrial Revolution and we're at the very beginnings of that. The question is, what is AI? And this is a big deal. If you want to be part of creating this future, understanding what is ai is vitally important, and this is really a simple framework. We were early to observe that, in fact, AI is a manufacturing industry. AI is not just software technology. It is software technology, but not just. AI, of course, runs on a computer, but the way that that computer operates is fundamentally different. Rather than a tool that's used by us, it is now part of a machinery and infrastructure, factories that are producing intelligence that are integrated into every single industry and application. A simple model is to think of AI as a five-layer cake. Energy powers advanced computers that are part of an AI factory that generates tokens, digital intelligence from the models that run on it that are integrated into every application. A five- layer cake. To be part of this AI economy, you don't want to just be consuming the AI. you want to be producing the AI. We could do all of that here in Europe. And in fact, we've already started. Europe is building its AI economy and its five-layer cake represented here. We've got great partnerships. And when you look across this five-layer cake, you can recognize that in fact it is a new industry because there's growth at every single layer. We're creating jobs, creating growth at an extraordinary rate. Companies here in Europe, Schneider, Siemens Electric, Siemens Energy, doing incredibly well around the world. We're the computing layer. We integrate into AI factories that are now flourishing all over Europe. Startup companies like Nebia is doing incredibly well. A new company called Firebird, which is setting up a new cloud in the Central Asia region and even cassava in Africa every single telco in the future and I predict this every single Telco in future with a hundred thousand sites representing some hundred gigawatts of distributed telco base stations and data centers will in the feature evolve into a distributed AI network so the AI infrastructure layer is being built out, which is then, above that, the AI models. It's really important to recognize that long before the AI models emerge, the infrastructure has to exist. Just as before you couldn't have an internet, you have to have the networking. Just before you could really enjoy the capabilities of electricity, you'd have to have electrified houses, electrified power plants. And so the models are the next layer it's also interesting to observe that the model layer is not just language models it represents language biology chemicals physics robotic actions animation and it represents models of all sizes these different industries are going to be powered by different modalities of AI models which then integrate into the AI natives the startups and there are so many here in Europe so the big the Europe's AI economy is starting and it's really accelerating it's great to see at the foundation of it where we contribute most people think is GPUs it is true we started in 1993 building a graphics chip which emerged into the GPU the programmable shading GPU over the time over time we added CUDA acceleration to that reinvented computing as we know it which then brought forth artificial intelligence but nvidia today is really a full stack end-to-end complete ai factory platform the breadth of the technology of our company over the years has really expanded everything from gpu computing vera rubin is our latest generation to the NVLink switches that connect them into one giant GPU, the Vera Bluefield 4 compute that we recently introduced, and I'll say a few words about that later, to Spectrum X, which is our Ethernet solution, making NVIDIA the largest networking company in the world today, to Grok 3, a decode accelerator for token generation, to Vera Bluefield 4 Storage Acceleration, but I'll say a few words in that in just a second, and then Vera RTX Compute, and I'll mention that in a second. But this now represents the breadth of technology necessary to create the AI factory. But nothing works unless you have software that activates it all. The first part is the system software that runs the AI Factory. These systems are gigantic. A one-gigawatt data center, one- gigawatt AI factory, costs about $50 billion. Land, power, shell, all of the compute, networking, storage, power cooling, all connected together. Multiple acres of AI factory. Just turning it on and operating it is a marvel in itself. The magnificent amount of software necessary. To energize this factory, to put it to use and produce tokens is an extraordinary feat. NVIDIA offers the entire full-stack software. On top of that are what we call the CUDAx libraries, the algorithms of our company. What NVIDDIA truly is, is an algorithm company that designs silicon to accelerate them. Of course, one of them is KU-DNN, what many researchers recognize as the library that brought forth, that started the big bang of modern AI, KU DNN. KU DNN is to AI what SQL is to the world's database industry. It's a domain-specific language, a domain specific library. Just as OpenGL and DirectX enabled real-time computer graphics, QDNN enabled the AI computing industry. 350 other libraries, those libraries are in fact the crown jewels of our company. Everything from computational lithography to signal processing, image processing, data processing, particles, fluids, sparse solvers. Incredible breadth of libraries that many of you in the audience have connected into your company. This is how we open new markets. This is what we do. This is the way we open markets. This is why we connect NVIDIA into algorithms that enable you to do computation at incredible speeds. And then finally, on the right-hand side, on that side, the models. This is new software. The new engine of new applications. And it sits on top of and it collaborates with the CUDAx libraries. These models, NVIDIA had been working on across multiple domains. With these models, it opens up new opportunities. And I have lots to say about that later on. Well, every single generation, NVIDIA started with Pascal. The AI era started with the Pascal new, what is called, DGX1 system. DGx1 brought to the world the world's first AI supercomputer. I introduced it 10 years ago, delivered the first one to OpenAI, started their computation journey. From Pascal, to Volta, to Ampere, then to many of you who heard about us for the very first time, Hopper, the current generation Blackwell, and then now Vera Rubin in full production. Notice six generations of architectures. With each generation, we advanced the technology. in the course of that last 10 years we've improved ai performance by 1 million times if you would take a step back and think about what would moore's law have done in 10 years time it would have the first five years would have improved by a factor of 10 the second fact second five years by another factor of 100x improvement in 10 year's time in the same period of time Because of the way NVIDIA extreme co-designs, we're innovating across every single computer, across every single stack of the software, optimizing new algorithms, creating new algorithms while creating architectures to accelerate it. Working across the entire domain, what we call extreme co design, we were able to accelerate AI by a million times. And we're going to continue to do so. This is what NVIDIA builds today, and this is the foundation by which we can enable Europe to be part of the AI ecosystem, the AI economy. Now, each generation, in the beginning, Pascal was GPUs, Volta was GPU, Ampere was GPU and Hopper was GPU. we invented the new dgx form factor then it was blackwell that introduced to the world the first rack scale computing and i'll show you that in just a moment rack scale competing turned one entire system into one giant computer one gpu and now with vera rubin we're extending it to processing beyond models, beyond large language models, to now processing the entire agent. Now, we'll refer back to this slide later, but remember this. The agent has to think. The agent Has to think, and that's where the model comes in. Perception, reasoning, planning, and using tools. All of that runs on the large language model, and the models are designed to do that. But the agent also has what is called a harness, basically this exoskeleton of the digital agent. Just last, we have the brain, the rest of our body represents our exoskeleton. The agent is the exosqueleton that orchestrates the work, that allows the agent to actually engage memory, active memory, working memory, as well as long-term memory, and activating tools. Then the third part is a computer that processes knowledge designed for data processing. And then lastly, a computer dedicated to CUDAx libraries, and its job is to run tools. And these computers now represent the entire agentic system. So Vera Rubin is in full production, It's nice to kind of see it. This is the first computer in the world that we've created. No cables, no wires, completely 100% liquid cooled. And it's just really delightful. Whoops. Hang on. Really delightful to be able to pull it out. And this is one Vera Rubin computer. Okay, so this has two GPUs. Yep. What used to take, in the case of Grace Blackwell, two hours to assemble one node. And when you see it, you'll know what I mean. Cables and wires everywhere, 80% liquid cooled. Now Vera Rubin is 100% liquid cold and it takes less than five minutes to assemble it. And so incredible, incredible achievement. Of course, this translates to higher cycle times in manufacturing more better real much much better reliability and of course a lot better performance this is the MV link switch tray and what this does is it connects 72 of these GPUs there are four of them in here right now it connects 72 GPUs into one gigantic GPU okay so each GPU is 20 petaflops connecting 72 of them into one gigantic system okay thank you thank you and this This is our new Vera computer. It's okay. Go easy. Let her give her a chance. Everybody has a chance to say something. But today, let me... No, no, take, just, I'll talk to you later. I'll take a break. I'll speak to you guys later. Thank you. All important issues. All important issue. But let me get through my keynote. We have, we have, so this auditorium is packed. we have a hundred other watch parties around the world a hundred watch parties 15 000 people are watching us right now and so i'll get through the keynote there's some really really fun things i want to show you in the end okay so you just have to you have to i have to torture you through some education first and then the entertainment is coming this this our brand new this is our brand new vera computer vera cpu is an extraordinary cpu beast eight instructions per clock it has the world's first lp ddr memory subs memory system so that we can have high performance very high bandwidth as well as extremely excellent energy efficient efficiency the on-chip fabric is the fastest of any chip in the world as a result data processing is off the charts agentic sessions starting and processing is off the charts and this is designed for doing exactly that this is our very computer and this computer here this computer here is the spectrum X this is the world's first co-packaged optics and you could see it here I'll show you some of this some of this area falls into the ground. And some of this area you can walk on. I'm just not sure which. All right. So if I accidentally disappear, you guys know us. It's not a stunt. It is an accident. And so you could see here, these are the lasers, and these lasers come up through optics, and it directly connects, directly connects to our chip. And it connects using a process technology we invented with TSMC called Coop. And so silicon photonics are directly attached right onto our chip, otherwise what you would see is all of this would be PC board, And PC board's transmission capability is much worse than optical cables. And so we now have extremely high data rate, extremely high quality data that comes directly onto the chip. And this goes directly into otherwise transceivers without going through a PCB and a transceiver goes right into the optics. Okay, so this is the world's first CPO. CPO, we're in complete volume production, and 512 port at 200 gigabits per second, the world's most advanced Ethernet switch, and we're really proud of it. Thank you. And so what that gives us is the ability to process the thoughts, the large language model, process the agent harness, run data processing for its knowledge, and then run accelerated computing for all of the tools. That represents essentially the agent workload, and I'll show you more in a second. While Vera Rubin is in full production, and the performance is off the charts, every single generation, as I mentioned, through extreme co-design, were able to achieve performances that are well beyond reason, well beyond what Moore's Law would have dictated. And as you know, Moore's law has really largely ended. And so we need these extreme co-design ideas, working from chips to systems, systems to system software, to algorithm, to the entire AI factory. Well, Vera Rubin is another giant step on top of Blackwell. Blackwell was about 30 times faster than Hopper in doing large language model processing. And now, Vera Rubin is another 30 times greater than Blackwell in just two years' time. Let's take a look at how Vera RubIN turns into what is a DSX full-stack AI factory. AI is creating the largest infrastructure build-out in history. The factories are massive. The investments are significant. We have to build it right. But great chips alone don't make a great AI factory. NVIDIA DSX is a full-stack AI factory reference architecture, co-innovated with the world's leading infrastructure companies. Compute, networking, storage, software, power, and cooling, co-designed as one system. Optimized from design to operation, DSX starts in a digital twin. Performance, power. Water and scale, validated virtually before construction begins. PTC turns equipment designs into simulation-ready assets. Dassault Systems connects rack and facility design through model-based systems engineering. Schneider Electric simulates power distribution and liquid cooling. Jacobs brings it all together in the Omniverse Digital Twin. Siemens evaluates thermal, acoustic, and grid impacts. And Procore supports construction phase planning. Power limits how much an AI factory can produce. DSX Max LPS is an end-to-end control loop that dynamically steers power to match workload demand. It uses 30% less power for the same output. DSX Rethinks Cooling NVIDIA Verarubin systems are designed for closed-loop liquid cooling with coolant temperatures up to 45 degrees Celsius. In suitable climates, outdoor dry coolers release heat into the air without evaporating water. At 2 gigawatts, DSX can save 54 million liters of water a day. That's the daily water use of 180,000 households. But an AI factory can take several months to build. Until it is operational, it produces no tokens. Today, we are announcing NVIDIA DSX Pod, bringing this full-stack platform into a factory-built, integrated system. It starts with Vera Rubin, NVL72. Seven liquid-cooled compute racks connected with 17 kilometers of Spectrum X cables form a Vera Ruben DSX pod. Vera Ruban DSX pods are integrated, fully cabled, and factory tested, then delivered in transportable containers. Dry coolers replace traditional evaporative cooling. 800 volts DC connects to the racks for efficient power delivery. Once site utilities are ready, estimated on-site deployment goes from several months to days. NVIDIA DSX AI Factory is responsible by design. And now, with DSX Pod, AI factories can be built at the speed of light. More intelligence per watt. Less time to first token. So, in 2016, we introduced the world's first AI supercomputer. It was in one node, one GPU node. And three years ago, we introduced the Grace Blackwell NVLink72 rack-scale computer. Both times, we had to reinvent not just the computer, the software, and how it works, but also the supply chain. In the case of NVLink 72, we took the entire rack, which would have otherwise been assembled on-site, and we assembled it inside the supply chain. We essentially manufactured supercomputers at scale. It is the reason why we're able to move so fast and be able to provide for literally several hundred data center build-outs around the world at the same time. Every single computer manufacturer in the world now manufactures NVLink 72. The scale at which we are now producing computing unheard of ever unimaginable well even then when you bring these systems onto your sites there are still months and months of assembly and you just heard 17,000 kilometers of wiring to connect just spectrum X for the scale out computing 17 kilometers 17,000 kilometers it's crazy number and so 17 kilometers incredible numbers now suppose we were to do that all inside the supply chain run everything up build everything up make sure that it runs completely get it qualified burnt in and by the time we ship it it is fully functional the amount of cabling and on-site assembly is going to be greatly reduced but there's something much much more in fact what's going to happen here is that by moving this into the supply chain the amount of idle computing the amount idle computing that's going to be sitting inside at your data centers will reduce dramatically remember this each gigawatt each gigawatt data center is 50 billion dollars the revenue generation you expect is tens of billion dollars per year and so we just said it's 40 billion dollars per year of revenue generation that comes out of that infrastructure 40 billion if delayed by just three months, that's $5 billion, excuse me, what is that? $10 billion worth of revenues. $10 million worth of revenue will make anybody anxious. And so by moving this into the supply chain, the speed by which we can turn on, go from installation, arrival of computing, to production of tokens will go from many months we think something along the lines of four to five months down to about a month okay so this is a complete transformation of the world supply chain and this will change the way that people install and build data centers and hopefully as a result velocity goes up the wasted idle compute the wasted idol capex will reduce and everybody becomes more profitable and so this is is MVLink 72 now into a large cabinet system. We call it DSX Pod. Okay, so this is the next click of NVIDIA Computing. Now, what you make and how you make it makes you special. Just as here in Europe, the work you know makes you special. You design machines. You operate factories. You discover medicine. You have extraordinary craft. That craft, that specialty, makes you a professional. That makes you so special. Well, what makes NVIDIA special are really two things. The first thing is that our architecture is the only accelerated computing architecture that is general purpose. We don't specialize on just one algorithm, for example, transformers. We specialize across anything that could be paralyzed. It could be fluids and particles. It couldbe quantum. It couldb quantum chemistry. It couldby image processing. It couldd be data processing, structured vector data processing. Processing of all kinds. And because we've been working at it for so long, And because NVIDIA's architecture has remained consistent for literally two and a half decades, the number of algorithms, the number of domains, the numbers of industries we serve, we accelerate, has grown tremendously. Our install base, our general purpose architecture, our dedication to this architecture, and our collaboration with all of the world's industries has made NVIDA's architecture literally everywhere. The second thing is how we do it. Of course, we have the architecture that we developed, but we also build it now in a full stack, complete AI factory. There are many companies in the world who want to design their own chips, but most of the companies inthe world just wants to deploy the AI infrastructure so that they can run their business on top of it. The ability to design a chip and build a supercomputer, write all the software, is really completely out of mind for most of the companies around the world. And so we now have the combination of these two ideas, CUDA, full-stack AI factories, and it exposes us to markets that otherwise is impossible. We're able to partner with so many companies here for this very reason. If I were to go around this, starting with CSPs, this is where most people think the vast majority of AI is today. But as you can see in the beginning of our keynote, I mentioned a whole bunch of companies who are not those. So CSPs remain very large businesses for the world's computing. But there are AI natives, companies that are starting all over the world. There are so many that are here. Neo clouds, because every region wants to participate in the AI economy. Every region wants to ensure that the valuable resources that they have, the energy that they have, is dedicated to companies in their region. For example, Mistral here in Europe. Mistral in France. Nebias here in Europa. So many companies around Europe that are building up neoclouds. OEMs and ODMs who are building computers for the world's enterprise. AI labs. Of course, we know about last year, all we spoke about was open AI. Today, we speak about open AI, anthropic, but we also talk about the incredible Meta's Muse, Grok, Bot, and of course, Gemini. So many different AI labs are now participating at the frontier. And then very importantly, and this is ultimately the most important, for AI to succeed, for Europe to benefit from AI and to have really created an AI ecosystem and AI economy, you need all of the end markets, the end industries to adopt AI and to succeed with AI. Whether it's in the automotive industry because we're building self-driving cars or the way you manufacture with robotics, the way your car is built, the way that you discover new drugs in healthcare, your financial services industry, all of these different industries have to become AI companies, every single one of them. Well, we have a unique ability through what I just mentioned about CUDA and the way that we build computers. We have a technique that we use to build computers, and we have the ability to build a computer that can do that. We have the unique ability to serve literally every single segment of AI. And so one architecture, many markets, and because these infrastructure are so significant and so expensive, we need to make sure that they're as productive as possible, as soon as possible. that they're fungible, that you can use it for every workload from the beginning of your AI journey, data processing to training to post-training, inference and agentic processing, every single step of the AI journey to every type of AI, chemicals and physics to languages, to every single industry and the algorithms that they use. And so NVIDIA's architecture is fungibole. And as a result of that, continuous innovation, continuous updating of software, because the install base is so great, we have such an incredibly rich ecosystem of software. Then these architecture is also durable, fungible, durable, productive. Well, that lays the foundation. That is the infrastructure. Now, what do we do with it? This last year, we saw a transition in AI. AI is now productive. And it's one of the most important times was in the beginning of the year when we spoke about OpenClaw, which introduced the concept of an open source agent. It really started what we all see across the world today. Agents think, reason, iterate, use tools, and as a result, consume an enormous amount of tokens. But as a resolve, they become useful. So more agents are being developed. They're more useful, and therefore they're used by more people. And because they have to use a lot of tokens to think, the amount of token consumption has gone through the roof. GPU demand has really gone throughthe roof. Now, what's processing it is this. This is an agent. These are the five elements of an agent, the first part are the language models. These arethe tokens that are running on top of the GPUs, And they're generating tokens that are consumed by the agent, what I call the exoskeleton. That open-claw harness sits inside a sandbox, and that sandbox isolates it from the rest of the system. This is a very important concept that I'm going to come back to. There are five things. There's the model. There'sthe harness. The sandbox that the harness sits in. And two other things, knowledge and tools. Models, sandbox, harness, knowledge, and tools. These are the five elements of an agent. Now, before I talk about how to make the agents useful, the most important thing is we have to make sure that the agent is secure. The agent is autonomous, and it's an autonomous system that has access to files, has access to resources, networks, access to tools. And we need to make Sure that the privileges that we provide this autonomous system is minimal and that we constantly monitor it we introduced a fantastic new product a new platform and it's called open shell open shell came just in time this is a secure runtime that provides for the things that i just mentioned and has an additional hardware-based monitor. Before I explain it to you, let's watch a video. SSH keys. That's the please don't approach. But hope isn't security. Safety isn't an aspiration. It's technology and engineering. NVIDIA OpenShell and Sentry put that philosophy into practice. You write a policy for what each agent can touch, and OpenShelly enforces it at the granularity of system calls, file access, and network connections. Formal verification checks every policy change against your permission ceiling, so agents never gain more access than intended. It's like the early Internet. Viruses were everywhere until browsers enforced strict limits on what a web page could do. Open Shell does the same for agents. Enforcement happens outside the agent, not just in LLM guardrails, bringing agent native security into your infrastructure. Every agent runs inside its own isolated sandbox, box with no direct route to the network. Every outbound network request goes through the supervisor outside the sandbox. It checks the action against your policy. If it's not permitted, it's denied. Keys stay outside with the supervisor and are added only on the way to an approved endpoint. A compromised agent can't leak a key it never had. The gateway is the control plane. The supervisor makes the decisions, the sandbox holds the agent, and the policy prover checks proposed policies against your permission ceilings. OpenShell combines Linux kernel isolation with runtime policy enforcement. NVIDIA Sentry adds an optional layer of protection outside the host itself, away from the agent. Running on NVIDA Bluefield 4, Sentry monitors agent activity and enforces security policies in a hardware-isolated trust domain. Because agent reasoning traffic passes through Sentry, if the agent is planning to do something unintended, it will update policies immediately and cut the connection to the model, quarantining it in milliseconds. And it keeps tamper-evident records that operators can verify for detection, investigation, and response. OpenShell is open source under Apache 2.0, runs everywhere your agents do edge to cloud and takes two commands to adopt install the cli create a sandbox and run your favorite agent agents are only as useful as the access you give them openshell and sentry put that access under your control that's how we advance ai capabilities and safety together. Agents are autonomous systems. We have to create extremely secure technology to make sure that we could develop these agents and deploy these agents safely. Now, it's incredible. After announcing Open Shell, just about every major company in the world, From the frontier labs to the operating system companies, cybersecurity companies, platform companies have come out to adopt Open Shell. It's really fantastic to see. And the reason for that is because this technology has arrived at exactly the right time, at a time when we want to deploy agents all over the world. Now, remember, this isn't just about the services using Open Shell as they deploy agents. This is really about all of the world's companies also adopting open shell so that you could receive these agents and have them run autonomously inside your company. Every single level of capability, every single task that you give the agent, for every person that uses the agent. Every one of those combinations requires a different level of privilege that you would provide to the agent and every single time an agent is launched, the privileges are different. And so privileges, the policy enforcement, the monitoring, all has to be done dynamically. And so OpenShell is really revolutionary. I'm delighted to say that Anthropic and NVIDIA are partnering to create cloud OpenSheLL agents. And so you can go to the website. There's a really great write-up about that. So the first part, the first part is how do you use these harnesses open claw, Hermes, open hand, you could create your own harnesses from Langchain, Deep Agents or just write it from Python. There's a whole bunch of different ways you could create agent harnesses that sits inside now an open shell secure harness. Okay? And that's the sandbox that it sits in the secure sandbox and then next let's talk about models there you should use uh models of all kinds in the future it won't just be one model that we run everything on we're going to run that we're to use the best models whether they're closed open or custom we're gonna use all the models to do your work sometimes the work that you do is fairly generic artificial general intelligence is going to do an incredibly good job. However, sometimes the work that you want to do captures too much of your proprietary knowledge, too much of your specialty, and you want to continuously enhance that intelligence. Every company in the future will use both closed models as well as open models that you customize. By the end of the session, you will see that, in fact, building your own AIs is not that hard. It starts with, of course, the model. We've been dedicated to advancing open models to open up new opportunities and enable people to build their own custom AIs. Nemotron is for languages. Cosmos is our world foundation model. We are the frontier. Groot for human and robotics. We are the frontier. Alpamayo for autonomous navigation, we are the frontier, iSync for quantum classical computing, we ARE the frontier and of course Earth 2, physics, AI, we Are the frontier so in all of these different areas we offer you all of the models and we're continuously working on it we've been working on for a decade and we'll continue to work on this forever we offer you the model completely open, the data that goes along with it so that you know the provenance of the model that we created, as well as the scripts necessary for you to reproduce it. So not only do you have the open weights, you have from us the entire recipe and the data to recreate the open models so thatyou could know where it came from and have complete trust into it well these models are not necessarily the frontier of frontiers especially for the language model however with customization and with partners that the ecosystem that we work with you could turn these models into frontier and as a result turn your proprietary data into sovereign intelligence. Here's an example of A21 helping Alice turn Nemotron into a model that exceeds frontier capabilities. Here is base 10 helping CodeRabbit turning a Nemotrons model after fine-tuning on your data turned into frontier capability, base 10 and CodeRapid. Here is trajectory in Harvey, again using Nemotronics, post-trained it and turned and created their own frontier-level capability. Here's SCALE working with Skydance, again doing the same thing. It goes on and on and the point being that you could start with an open model, something that's incredibly good like Nemotron, and with your own data, post-train it for your use case and achieve, of course, super intelligence. That is a very sensible thing to do, and all the technology exists today. Here's an example of Palantir with Tampa General Hospital. The list goes on and on. We have a rich ecosystem of partners that can help you. And they're incredible companies. And they can work with you, you know, from around the world. Okay. So we were, it's just, anyways, I'll mention one and I'll offend everybody else. I'll have to sit here and mention all of them. and I love them all. And so first, agent harness running in a secure sandbox open shell. Second, Nemotron large language models, the first two components of what you need. But ultimately, what turns these super agents, these agents into super agents is that you give them access to your company's knowledge. And this is really special. This is called the Agent Knowledge Foundation that we put together. Libraries and models that are completely world class. It allows you to turn your company�s data, the data could be in, the assets could be in unstructured format and documents so that you need an AI to understand how to read these PDFs and read all these unstructured documents, or it could be in structured data inside databases. We have the libraries and the tools necessary to help you extract meaning and understanding from your company's data. One at a time, Nemotron Parse, completely world-class, top of leaderboard. Nemotrion Embed, taking a query and associating with the knowledge that's inside the vector database, top-of-leaderboard. Nemotron, re-rank. It might find many different sources where the query is associated with different pieces of data. It brings it together, ranks them based on which one's the most relevant to you. Kumo, to be able to predict from your structured database what is likely to happen. And so this is, for example, if you were to receive a notice that one of your suppliers will be short on supply or delay on supply. That piece of information is likely unstructured data. It's a document. The information about the orders in your company are likely inside a structured database, your SQL database, for example. And in order to predict what's going to happen to all of these orders, who are going to be short, the amount of delay you use kuma to make that prediction and then in order to figure out what to replace it with you might use vector database search and to go find a engineering document of a replacement component okay so all of those different libraries and data processing capabilities now makes for you your knowledge foundation you've now armed your ai with proprietary data proprietary knowledge. Now, the last part that I'll talk about is ultimately tools, tools of the trade. NVIDIA has been working on CUDAX, and for most of you, in the last, before AI, all of our conversations have been about around how do we accelerate simulators and solvers, data processing engines, domain-specific libraries of all kinds. They're used in scientific discovery in all the different fields of science. They're used in engineering. They're use in research. They're us in designing, building, creative arts. At this core are CUDAx libraries. And these CUDA x libraries are algorithms. And algorithms, as you know, are beautiful. Let's take a look at it. I love you. We'll be right back. Thank you for watching. Thank you. math is beautiful math is beautiful. CUDAx libraries, these are the crown jewels of our company. And the reason for that is this. When you're building an AI assistant, it could be a lab assistant. It could be a research assistant. It could be a co-designer, somebody who's co-creator with you, building something with you. Ultimately, what makes those agents useful, what makes them able to do real work are the tools. And So we now have models that allow these agents to reason, understand information, reason, to be able to plan and iteratively act and use tools until it could get the job done. But it still comes down to the tools. And these tools we've been working on for so many years. And there was one particular computer I showed you on the right-hand side that runs every single one of these tools. And it could be fluid dynamics and particle physics. It could be quantum chemistry. It could data processing. It could ray tracing. All of these tools run on that one computer. And that one computers speeds up the processing of it compared to just running it natively on a CPU by 10, 50, 100x. And CUDAx tools is what give the agents the tools of the trade. And it's so cool to see how other people are using it. Let's take a look. So this is the magic, magic behind the agents. Ultimately, the agents have to use tools. Now, of course, in one of the first fields of agentic use is software programming, and therefore, a compiler or a Python is all really at needs. But in the future, as we have these tools do more and more andmore and more useful work, we're going to need to give them more tools. And here are some examples. So here's Lida Sciences. They're creating a lab assistant, and they're using NVIDIA's Bionemo models that are designed for understanding proteins and understanding cells and generating proteins and chemicals in drug discovery. They're using BioNemo and CUDAx tools. This is Siemens Factory building a factory agent that uses NVIDIA Cosmos, our world foundation model that understands the physical world and CUTAx tools, and here's an example of Dassault creating a virtual companion that uses Nvidia's Nemotron, our language model, and CUPAx tools Let's see them in use. and unstructured data. Tools let the agents simulate, experiment, and act. NVIDIA Open Shell controls what agents can access and execute. Start with a frontier closed model or customize an open model. With NVIDA's Agent Toolkit, any company can turn its knowledge and expertise into a customized super agent. Let's look at three examples. For Lyla Sciences, the goal is to design a therapy for B-cell lymphoma. The Lila Iris agent, built on NVIDIA Nemotron, turns that goal into an experimental plan. In the computational dry lab, Lila agents use NVIDDIA BioNemo agent toolkit to call models for protein design and RNA optimization, running millions of virtual experiments. The most promising candidates move into Lila's AI science factory, where autonomous robots and instruments, developed with NVIDIA Omniverse and Cosmos, make and test them. The results return to IRIS, shaping the next designs and experiments. The loop continues. At Siemens Electronic Factory Erlangen, the goal is to bring new products into production. Process Preparation X agents use NVIDDIA Cosmos to generate virtual prototypes and synthetic data, then train and validate inspection models before production starts. Intelligence Center X Agents, built with NVIDIA's factory operations blueprint, use orders, supplies, and line setups to recommend production plans. Digital Twin Composer uses NVIDA Omniverse libraries to validate those plans with physics simulation and real-time factory data before changes reach the factory floor. With the Dassault Systems platform, an engineer needs to adapt a Volkswagen Golf Door design for the Tiguan. Aura and Leo use NVIDIA Nematron to reason over engineering requirements. The harness coordinates the specialized sub-agents and preserves context across planning, design, and simulation. Aura uses Inovia to plan the work around the vehicle's dimensions, weight limits, and other engineering requirements LEO Design Agent selects a compatible golf door design and uses CATIA to reshape it for the TIG one. LEO Simulation Agent uses Simulia, accelerated by NVIDIA CUDAx libraries, to test the variance, revealing a vibration problem. The results return to the Design Agent for refinement. The engineer reviews the refined designs and selects the final one. Different goals, different expertise, the same building blocks. Open Models, CUDAx Accelerated Tools, and the Open Shell Secure Runtime. Brought together with the NVIDIA Agent Toolkit. Isn't it great? Some people said that AI is here, it's gonna be the end of software, it's going to be end of tools company. It's exactly the opposite. AI is hear, there'll be more users of these tools that we created over time than ever before. Every single tools company will now become an AI company. They'll be an agents company. Not only will they offer tools, but they'll offer you specially optimized agents that are incredibly good at using their tools. Cadence and CrowdStrike and Dassault, IQVS, and just about every enterprise company out there are all building agents, and we're just delighted to be working with them. Building agents is not that hard. It's got five components. It's Got the model, the harness, both of them have closed and open versions, but the open shell secure runtime. And then most importantly, the knowledge and tools and those knowledge and tool belong to you. That's your expertise. And so all of this is now possible to do. And I'll show you more in just a second. But before I do that, let's talk about physical AI. That's really the next wave of AI. AI that understands the physical world can reason about it because the physical world is diverse, it is complicated, it's got extremely long tails, and to reason about it and use appropriate tools to interact with the physical world. Whenever people think about physical worlds, they think robotics. In fact, one of my favorite physical world applications is the radio, cell phone, cell towers and the reason for that is this it uses instead of cameras instead of speakers and microphones it uses radio waves to sense the world and to you know it reasons about it it processes information reasons about and interacts with the world using beamforming so in fact this is an application, a technology, that is just perfectly suited for AI. AI will revolutionize the way we do telecommunications. It will enhance our spectrum efficiency tremendously, just as we've done so with ray tracing. All of the graphics that you've seen completely 100% ray traced. The amount of computation we thought necessary in the past and now that we apply AI to It's a million-to-one difference. And so we're going to bring to the telecommunications network an enormous step up in spectrum efficiency. But beyond that, we're also going to revolutionize all of these cell towers. There's 100,000 sites around the world, around the Western world, about 100 gigawatts of distributed data centers that will, in the future, become a distributed AI infrastructure. We're delighted to partner with many companies here in Europe. And just this last week, after working on this for nearly eight years, NVIDIA made the first commercial phone call on the T-Mobile network with Nokia. And so now CUDA makes phone calls the traditional way. Then once it can do that, then we can layer AI on top of it. And so the revolution is going to begin. This is a really exciting opportunity for us. The other physical AI application that I'm super excited about is essentially robotic radiotherapy. The tumor is changing in shape. The physical body is changing while you're in therapy. The robot, this adaptive radiotherapy system, has to perceive the changing environment, understand where the tumor is, segment it just perfectly, and precisely direct the radiotherapy accordingly. Essentially, robotic, that's right, go ahead. This is a form of robotic surgery. Now, of course, the highest volume, the most near-term robotics application or physical AI application that everybody recognized has been something we've been working on for over a decade. And now we recognize that every single car company will want to make their cars part of the ride-hailing fleet. Today, we have ride-hailing, and it's part of Uber, and here in Europe we have Bolt, and we have Grab, and Lyft, and so on and so forth, and all these different ride-mailing services. In the future, there will be robo-taxis that will be connected to those ride-tailing services as well. But it won't be from just one brand. And so we recognized that building these systems are incredibly expensive, particularly the software that goes on top of it. We decided to create one standard architecture, 14 different cameras, nine radar systems, three lidars, umpteen ultrasonics, this cocoon of a shell of sensors powered by dual NVIDIA GPU systems for the AV computing system. We turned this into an industry standard, and now it's being designed into one car fleet after another. On top of it are AV software companies, and we are in fact one of them as well, to build an autonomous robo-taxi capability, which then is connected into the ride-hailing services. This ecosystem is being built out. The world travels about a trillion miles per year around the world. Many of those miles in the future, you know, a dollar or two per mile, are going to be on robo taxis. So this is one giant opportunity, but it's incredibly fragmented. And so creating an industry standard, Hyperion, and working with an entire ecosystem, we could create essentially a giant virtual fleet that everybody can connect into. Today, I'm super proud to announce that four more brands, four more cars are going to, lines are goingto come in. The VW van, I just can't imagine anything more iconic. The JLR, brand new car. The Volvo fleet, as well as Mercedes next generation are going to be also Hyperion-compatible and be part of this network, this ride-hailing network, RoboTaxi fleet. So welcome to Hyperion. The next major industry, the next major history, the next great industry, and this one is likely to be extremely large, is human or robotics. There's a reason why robotics is hard to do. because all the different work is rather diverse. And so building a special configuration for each one of the diverse tasks segments the robotics industry into all of these different configurations, which prevents the technology flywheel to happen. The reason why the cell phone has advanced so quickly, the reason why personal computers have advanced so quickly, the reason why NVIDIA's NVLink 72 has advanced so quickly is because those standardized configurations allows many customers to use it, the volume to therefore be derived. That volume drives the technology flywheel and it gets faster, better, incredibly fast. And so we need a robotics configuration that is as standard as possible. Now, human robotics obviously has the ability. It probably isn't perfect for everything, but it's likely to work for many things. As a result, this is likely going to be the largest volume robotics configuration. Now, if we could just create the AI that allows it to learn very quickly, then for small, medium businesses who don't have an entire robotics team to teach and program the robot can now show the robot what needs to be done. The robot, because it has general capabilities and general intelligence, would be able to learn and adapt quickly. And so this is likely to be the next major platform, technology platform. We're working with so many different companies. You will recognize many of them here in Europe. This is your great opportunity. No country, no region has dedicated itself to making megatronics, electronics, mechanical systems at the level of precision and craft as the European region. So many companies here are incredibly good at manufacturing. This is going to be the next high-volume industry. And you can see there are so many companies that are now part of it, and we're delighted to be partnered with you. Now, in order to create a physical AI system, you need three computers. The first computer is the one we've been talking about, and everybody knows quite well, which is training the AI model. The second computer is where we have the AI learn how to do its skills. You can't just have the A.I. program the A。I. and have the A.i. come out into the physical world and try to do whatever it wants to do. You do it inside a digital twin. We create a digital twin called Omniverse, and you've seen us talk about that repeatedly. In fact, just now, when you saw all the CUDAx libraries, they're all being done inside a Digital Twin world. That digital twin world that's called Omniverse. Omnivers is a library that's connected into all kinds of platforms and tools, Siemens and Dassault and Cadence and so on and so forth. And so you could see these digital twin systems being created. The second computer. The third computer is the robotics computer. That computer integrates in the case of the self-driving car, the robo-taxi, We call it Hyperion. Hyperion consists of the computer itself, the functional safety system, the active safety system. An operating system designed for physical AI safety. What we need to do exactly the same for robotic systems. So that every single time you start to develop research and start to work on your own robotic systems, you don't have to start from scratch to cobble up all of the software and computing systems and the sensors and all the mechanical systems that alone would take several years and so we decided to build a reference robot this is the NVIDIA agile one in partnership with agile robotics this robot is going this reference robot will be available in the first quarter of next year and it will come pre-assembled with computer inside software integrated and it should be able to perform quite well right out of the bat and so this is a great starting point and it'll be the flywheel by which we can accelerate development of robotics well let me start let me end today's speech from where we started. NVIDIA started in the PC revolution. It was in 1993, and the PC revolution was just about to start. Remember Windows 95 kicked it into turbocharged. We came since then, invented the GPU, programmable shading, real-time ray tracing, we added CUDA to the computing model, and helped ignite the modern AI revolution. And so four years ago, we started to think Like, what can we do to reimagine the personal computer for this new era? Where the personal supercomputer is not just your tool, your personal computer tool, but your personal agent or your personal assistant. And the way you interact with this computer would be essentially a companion, somebody who helps you do work. And so this computer needs to have exactly the five things that I mentioned today. It needs to be able to run on a computer It needs a model. It could be running locally or it could be run in the cloud. It needs an harness. It needs secure runtime, open shell. And it needs access, because it's available on your PC, it needs knowledge and tools. And the good news is, because NVIDIA has been accelerating tools for so long, If we could just create a computer that can accelerate OpenGL and DirectX and everything CUDA, everything NVIDIA has ever worked on would run on this computer. And so this is it. After four years of partnership with Microsoft, we have created the RTX Spark. And this is a brand new line of computers. Literally thousands of years, thousands of engineering years went into this. we've been secretly working on it for four years created a chip called the n1x and then we just recently announced it with the entire pc industry joining forces we created desktops laptops and workstations this is one petaflops one peta flops just to put that in perspective in the year 2016 I delivered one petaflops and 128 gigabytes of memory. One petafflops and 128 gigabytes to a small company called OpenAI. This is one petalflops and 128 megabytes. 128 gigabytes. The only difference, of course, is that I can hold this like this and dgx1 took two people to carry upstairs and so this is the brand new rtx spark pc and if you would like to have a companion workstation that runs katia and everything the so and everything autodesk and auto you know adobe and cadence and synopsis you can always get yourself a dgxtation that runs Windows, and this is 20 petaflops and 754 gigabytes of memory. And so, incredible. And of course, there's also the desktop version. All of these are now available, and I think the DGX Station with RTX Spark, with DGx Spark, DGxtation with Windows will be available at the end of this year. Now the question is, so far I just talked about the five components of an agent, and now the question ist, how do you build it? How do you built an agent that runs, let's say, on one of those computers, or runs in a cloud, or run on-prem somewhere? Well, the answer is it's really easy, and you do it this way. The way you build an agent is you ask an agent to build it for you. So this, this is the prompt that is going to run the next application. And what you're about to see is this. You're about the see a robotics application. And while you're watching this demo, just remember, there's an agent running on this personal computer. This demo runs across three computers. The first computer is to train. The second is a digital twin. And the third is to put that AI into the computer itself. Okay? So two ideas. The first idea is agents. How do you build it and run it? And what you can use it to do. And the second is physical AI computing model, which consists of three computers. Let's take a look. Meet Microduck, Hugging Face's robot. Let's teach it to see and walk with NVIDIA RTX Spark. I use Hermes as my agent harness, Nemotron and OpenAI's GPT-6 Astra as my models, and CUDAx accelerated tools FreeCAD, Blender, and Isaac Sim, Newton Physics Engine, and Isaac Lab. I'll run everything on my RTX Spark, except when I need to burst larger workloads to cloud. First, I describe the course and what my Microdot needs to learn. On RTX Spark Hermes and Nemotron plan the course, listing every object required. Astra takes it from there, using FreeCAD to model 3D objects, Blender to apply materials, and Omniverse SimReady libraries to add physical properties. In IsaacSim, Astra composes the scene. Astra rigs Microduck's joints, actuators, and links, and simulates how Microduk moves with Newton physics engine. Now training begins. In the cloud, thousands of Microducks train in parallel in Isaac Lab. Every fall, a lesson. Improving the policy every time. Omniverse libraries simulate Microduck's cameras, teaching it to see. With perception and physics working together, my Microduc can avoid obstacles, navigate tight spaces and adapt to its surroundings. I download the policy to RTX Spark and use Nemotron and Isaac Sim to evaluate my microduck with multi-robot orchestration. I deploy the validated policy to the real duck, and he's on his way. NVIDIA RTX Spark, build and run AI agents and their accelerated tools right on your laptop. Hey, guys. Oh, yeah? Okay, come on. Here, come over here. Show people you can walk. And you have a camera. Oh, yeah? Don't trip. Can you guys sit down? Okay, stand up. Take a nap. Take a lap. You need to take a nap Okay, stand up. Did you know that you were created in here? You were created on RTX Spark. I know. And trained you in the cloud on a whole bunch of NVIDIA supercomputers and you learned your skills right here on RTX Park in a digital twin, the Omniverse digital twin. isn't that incredible I know I know you guys are so cute and your parents are called Pollen P-O-L-L E-N is that right uh-huh Pollen Robotics and apparently everybody loves you guys so much you're sold out I know so if you go to the Pollen website everybody Everybody watching this, you know, there's going to be like 20 million viewers. Everybody watching This, go to the Pauline website and place an order. I think this startup company is like 10 people. They might blow up. It's going be so exciting. Everybody should have one. You guys are so cute. And so we'll just have an RTX Spark and we'll teach you new skills. Isn't that right? Oh, look at that. That's incredible. Can you do a somersault? that's so good that's so good wow okay well guess what okay so today what did we talk about we talked about Europe building its AI economy and it starts with infrastructure and we announced a brand new system called DGX Pod. It makes it easy for you to build AI factories. And these AI factories don't just run models anymore. Pay attention. Stay focused. Come here, come here. Come over here. Stay focused and these AI batteries don't just run, there you go, sit down, yeah. They don't run AI models anymore, they run entire agents and these agents are consistent of five things there's the large language model that does the perception reasoning planning and acting and it runs in conjunction with a harness that turns it essentially exoskeleton and runs that harness sits inside runs inside a secure runtime we call open shell which has just so many people that have supported it and you give it access to knowledge and tools. And this agent runs on top of these computers, but we're also extending into the next generation, which is where you guys come in, physical AI. So that's it. That's what we talked about. Everybody can build agents. Every company in Europe will become an AI company. There's no question everybody will become a AI company, and we're going to have a thriving AI economy here in Europe. So after 33 years, what an incredible journey. And we made a really cool video. You guys want to watch it together? Okay, come on. Come over here. Just come over here just a little bit. We'll get out of the way. Come on. Top speed, top speed. How the heck are we supposed to follow that? Well, there is one thing that can make this crowd go even crazier. What is it? You won't believe this! GTC has just gone full Eurovision! See, we'll break it down for you, Germany. This is a story all about how the world's building new. In for now, first power plants, let energy scale. Then came data centers, now we've got mail. Now we're way past turning coal into what? AI factories turn sand into thoughts. Move over oil, the S&P too. There's something more investable, RGPU. It works like an asset producing green Looks like a chip, acts like a cash machine They make revenue while you relax The cash flows smoother than this sand Agents code and make decisions Give them freedom but control their missions Open shell on Varus, checking the list No credentials, access dismissed The sentry on Bluefield never clocks off Protecting the sandbox like Hasselhoff We advance AI but limit risks We're responsibly optimistic RTX Spark keeps agents safe and bright Our spark rates keep the price just right We do quantum rexes, gaming all in one Cause you can't spell fungible without fun AI's got a body, now it's learning the rules of gravity, friction And using real tools, with Isaac Lab and Cosmos They train on their own, it's like college for robots Without student loans, DSX pods give AI in sync Less power, more brains, like Legos that think QVS, Name, Matron and Kumo are here Throwing knowledge faster than a burly cashier Europe's full stack, it's all on its checklist AI's five-layer cake, it eats it for breakfast The Euro-recon system is leading the race In love's open source, just ask, hug and face The continent is rising and the best is yet to come Come on all of Europe, let's sing as one We are Europe We are Europa You and me Welcome all to GDC Welcome to GTC. I want to thank all of you. I want thank all the sponsors. You can see all the names of companies that are here. All the partners we've been working with for 33 years. micro duck my new friends um let's work together to build europe's ai economy and put ai to work all right give everybody have a great gtc Thank you for watching.