24 hr AI conference: Optimizing industries through Unlimited Reality & NVIDIA’s Omniverse (US)
As reality evolves, we enter new eras areas of creativity, of industry and technology. Today, we are entering an era of new dimensions where reality becomes unlimited, an era where factories are built virtually before laying a single brick to lower cost. In an era where 3D training environments improve workforce safety and workplace satisfaction, in an era where new immersive experiences allow brands to connect directly with their customers, to increase loyalty and affinity. A brand new era for our planet, for 3D imaging and synthetic data that can help prevent wildfires. The unlimited reality era is here. Hello, everyone.
Good morning. Good afternoon. Good evening.
Around the globe. My name is Frank with you and thanks, Akkad, for giving the warm introduction and I'm so pleased to be here with Danny. Danny. Thanks, Francis.
It's really great to be part of your program and we're super excited about everything we've been talking about from from the now into the metaverse. Yeah. So I would have to say that we talked a lot about all that amazing, all the jazz, all the rage on A.I.. And when we started looking at just as important as foundational with the statuses and real shifts from what's happening, the web is turning from 2D to 3D.
That's a core metaverse concept that we've been working a lot with the India around, right? So now folks are oftentimes ask me, Hey, Francis, what is a limited reality? But it is a convergence business that Deloitte launched, focusing on the business and technology transformation. And we're the part of the magic is really air meets 3D data meets design and I think one of the things I wanted to just chat a little bit about is around the how we got here. I think how we got here is really important in looking back over the past decade or so, Danny, what we have seen is unprecedented innovation and investment across all the layers of the internet, right? We're seeing that a lot of the visible piece on the international intellectual layer that includes your air VR, X or devices or smart glasses, voices, haptics, that layer of the Internet we've seen the pattern has tripled over the past decade.
Now we're not stopping there. The computation and information layer growing at even faster rate. So what we're seeing all the magic today are no accidents. There is something new. I been working with the Silicon Valley ecosystem over the past couple of decades. Unlike the previous generations of technology shifts, I'm seeing that industry taking much stronger leadership in shaping current wave of technology use cases and in turn, in fact, shape the technology roadmap.
So before we dive into today, we're going to use the next half an hour. So then in and I going to cover some of the use cases in the stories around the three domains where a limited reality focus on the customer domain, the operations domain, the workforce domain, and collectively transformation of the next business. I would love just to invite Danny. Danny, you're an automotive insider. The if I looking at automotive today is really software on wheels and the industry has changed significantly.
So before we dive deeper on some of the air meets Metaverse, our core use cases are love. Just to hear from you, a bit of general observations. As an industry insider.
I think, you know, all industries are going through an amazing transformation. Our eyes, a big part of it, 3D is a big part of it, but we've been talking about virtual reality for four decades. It's been around for a long time. 3D graphics gaming, that's where Nvidia got started. But the difference now really is that instead of each person having their own machine, their own individual device, having their own experience, maybe using different apps or incompatible parties, now what we've done is connected everything together, right? All these tools can be used harmoniously and people around the globe can collaborate. If you look at how media and entertainment has evolved, it used to be, you know, designers or animators were again working on their individual workstation and they would create a character.
They'd have to save that out and give it to somebody else, and they would work on animating it and they'd save that and somebody else would work on a different part of the scene or the camera work in the lighting. Well, now, using tools like Omniverse, which enables these artists, these designers, these animators to use whatever tools they want but have a shared common space, they can all be working simultaneously. And so this applies not just to animation for companies like Pixar, because, you know, we've been working with them on what's called the universal scene descriptor language, which pulls everything together and makes it unified. But we're seeing it in healthcare now.
People can collaborate and be creating 3D models or getting data from scans, and doctors can can work on remote patients through this 3D visualization. We're seeing it in architecture, We're seeing it in any kind of industrial applications and automotive too. For us, we basically create this whole end to end platform where the designers who are doing the concept and styling, I think there might be a slide out of this. If you guys want to shop, great.
So, you know, for the people who are doing the initial concept work, they're working in their 3D tools and they can pass off some of these designs to the engineering team and they can run their computational fluid dynamics simulations and visualize how efficient the vehicle will be because of the the drag on different parts of the vehicle. Or they can do virtual crash test simulations. We can then take all of the systems inside the vehicle and simulate the software. And what does the user interface look like and how does the graphics in that dashboard match the physical aspects of the car? So again, we've gone into this virtual space and now all the things that used to be done physically manually can be done in a digital twin first and experimentation is super easy. Then this goes into the factory. We can do layouts of the factories before they're built.
We can simulate the production line, we can simulate all the robots assembling the vehicle and optimize that before the factory is even built and really save a lot because we don't have to rework things when they find out that, Oh my God, the building wasn't big enough. We know that in advance. And then all this data that's come together to create these cars can be used for retail experience. So online and virtual reality, augmented reality in a digital showroom, all that data used to build the car is used to help market and sell the car.
And then another part of it video leverages all this data for autonomous driving where we can simulate all different kinds of vehicles in different road scenarios, in different weather conditions and different times of day, and really be able to validate the technology before we even put it on the road. So this platform just in this one industry has a massive set of use cases and it all is just built on this new cloud computing technology for artificial intelligence and for 3D. And we call it the omniverse. The I would say that the industrial era has been around for over 260 plus minus years.
And as we entered the A.I. meets 3D, the whole industrial metaverse era. I think we really have to reimagining how the core value chain got put together, how the new era undoubtedly is going to take the business operations into a new realm. Now, I want to just kind of the unpack this a little bit like So, Danny, you covered end to end really looking at a platform transformation perspective. So let's take a deeper dive into the functional area.
So we touched on how A.I. needs are changing the customer experience. And in particular I am seeing a lot of and in collaboration with the Omniverse team and immediate enterprise A.I., a lot of the shifts we're seeing is at the Synapse player and the See Accelerate is not just about the interaction with sales marketing services.
It is also impacting fundamentally how the new vehicle experiences the design experience. As you talked about. Right? So and it's also powered by EDGE. I've read whole host of Perception Technologies, Advanced Connectivity. So I would love to also just to the get your take in terms of what you're seeing specifically around the C side, how in video from all the work that you've done within the automotive space, some of the broader applications and specifically also what the all the rage of generative API, it's also changing the game.
I think there's there's obviously a lot of different aspects of the customer experience. One of them is inside the vehicle and we are putting AI supercomputers inside the vehicles that were helping to develop Mercedes-Benz S, Volvo, Polestar, Jaguar, Land Rover. They're all adopting our technology in their fleets. And so by having a powerful computer inside the vehicle, not only is it processing the sensor data from the cameras, the radar and the light are outside the car and enabling them to drive much safer than a human could. But we're able to take sensor data from inside the car so there could be facial recognition, could be eye tracking for safety, for voice and gesture.
And so now, using large language models inside the vehicle, there can be a dialog that you would have with what we call the drive concierge, somebody who knows everything that's going on with that car. You can control a lot of the vehicle with voice. You can have a conversation. A lot of it needs to be processed on board because you don't want to have to wait to go to the cloud and come back. You're not really going to have a fluid conversation. But if you're searching for information that could be weather related, location based information and movie times search for restaurants, obviously that is going to go out to a larger database.
But there will be this hybrid handoff between what gets processed in the car and then what what goes out to the cloud with respect to know, generative AI for the design. I mean, that's one aspect. You have the evolution of these applications, design applications, CAD applications, where the interaction can be not just, you know, clicking on a mouse, but again, a dialog with these applications. And so they get much smarter through these large language models. So you could ask you could design something and ask for the software to generate permutations on that. And so using tools that we've developed, working with third parties like SO or Adobe or Autodesk, they're able to integrate some generative AI technology into the software and be able to build other permutations.
Maybe you've created something and you can ask it to come up with some other designs with a lower coefficient of drag, and so it can then analyze what you've created and make modifications to it. So like in this previous session, you have this set of assistants, these AI interns, right? Who can go off and try different things based on sort of the physics of the real world, but doing it in this virtual world. I mean, omniverse is one of these tools that obeys the laws of physics. So it knows that things can intersect with each other, it understands gravity, it understands, you know, wind resistance and things like that. So we can model all types of different scenarios and look at those results.
And it becomes, again, a a colleague of the designer to make it better. Yeah, I actually believe we've been talking about humanizing technology for as long as I can remember around digital transformation. Now with the currently with the A.I. needs the immersive lab we started really, truly start to see that possibility in terms of applying the perception technologies, applying the learning aspects. I also want to share the about five years ago I was in Singapore at Deloitte's Future of Mobility Center.
I was on a panel and on the panel we had Uber. We had the leading and leading luxury auto auto brand. We had also fintech startups and the debate of the time was, is car a product or is car A services? Right? I think five years later and when I have dialog with one of our mutual client, BMW, they really look at CAR as powered by A and X are technologies car is actually a companion so I thought that was truly remarkable.
Five year evolution. Now, Danny, I'm going to pivot a bit into the operations side and we talked a lot about is kind of a broader sense. We talk about design, product, manufacturing and a whole space around make, right? And some of the core enablers we start looking at.
You mentioned the word physics space to draw to reality representation and you mentioned the core concept around collaboration. And at a limited reality, we call this whole field around enterprise simulation, simulation of independent processes and systems, simulation of interconnected process and systems. And also the Grand Slam would be simulation of entire global operations. Right. And this is also space we work really closely as as partners with you guys. And in building digital Factory or in building the twin was help us to unpack this a little bit And I would also, as you and I talked about this in the past, it is such a great virtual production before simulation.
Before production is such a powerful concept. What are some of the things that's really also in the way of companies adopting it? But I think that the ability to create this digital twin is a huge cost savings over the life of the product, the production. It's a huge timesaver and and it's ultimate going to improve quality because it lets you experiment and optimize before you implement. And so what we're doing is now everyone's seen a CAD program where somebody will design a building and you just have this kind of static model of the building. Instead, what we're doing is we're bringing it to life and so we can just at a basic level, simulate what the lighting is going to look like inside that building. It's physics based reality.
We're modeling the light rays and it's called raytracing, so we can figure out what's the optimal location for windows to maximize the light, but also minimize the heating and cooling. So that's just on that structure. But then every element that goes into that factory for modeling that we have a digital twin of that robot and that conveyor belt, even that we can model the people.
Just like again, a Pixar would have characters moving around. We can then simulate every aspect of that factory and see how the robots interact. The optimal placement of those robots where they the conveyors need to go, where the cranes are, lifts for the cars moving the factory. These are extremely complex operations.
Anyone who's been to an assembly plant is just usually blown away by the complexity. Thousands of parts need to come in. They need to get to the right place.
They need to fit into the process of these robots or the humans. And again, what we can do is model all of that and optimize that before it actually becomes a physical plant. And so huge cost savings, huge time savings, and even it makes it a safer place to work, right? We can anticipate where there might be problems, where a robot is moving and we need to ensure that, you know, no one is going to be in harm's way. So a huge benefits to these is digital twins. I think there might be a video if you guys wanted to, to show that we can see how both we have Mercedes-Benz, we have BMW who are implementing this and they've worked with again.
So this is not a photograph. This is a simulation of the factory. So it's been modeled.
All the different elements are modeled in here, the lighting and the operations of it, how the different parts would move through the factory and in the logistics. Right. How do you get all the parts from unloaded from a truck to the right place on the line? How does that all work together? The models industries are accelerating digitalization with over $3.4 trillion being invested in the next three years.
We at BMW strive to be leading edge. You know, automotive digitalization with Nvidia, Omniverse and A.I.. We set up new factories faster and produce more efficiently than ever. This results in significant savings for us.
It all starts with planning a complex process in which we need to connect many tools, data sets and specialists around the world. Traditionally, we are limited since data is managed separately in a variety of systems and tools. Today, we've changed all that. We are developing custom omniverse applications to connect our existing tools, knowhow and teams all in a unified view.
Omniverse is cloud, native and cloud agnostic, enabling teams to collaborate across our virtual factories from everywhere. And I'm about to join a virtual planning session for the ambulance city in Hungary. Our new event reopening in 2025. Let's jump in.
Milan is joining. Hello, everyone. I'm along. Great to you.
You're in the middle of an implementation look for the body shop. What do you like to see? Thanks. I'm highly interested and I'd like to invite a friend. Sure. Hey, Milan.
Good to see you, Jensen. Welcome to our virtual planning session. It's great to be here. What are we looking at? This is our global planning team who are working on a robot cell in the digital twin.
Mathias. Tell us what's happening. So we've just done the production concept required some changes. We are now reconfiguring layout to add a new robot into the cell. Okay.
But if we need a new robot on the logistics side, we need to move our storage container. All right, let's get this new robot in. That's perfect. But let's double check. Can we run this? So excellent.
Milan, this is just incredible. Virtual factory integration is essential. For every industry. I'm so proud to see what our teams did together. Congratulations.
We are working globally to optimize locally after planning operations escape, and we've already started to celebrate the launch of our virtual plant. I'd like to invite you to open the first digital factory with me. I'd be. Honored. Let's do it. So what's different about this start? It's not just an animation.
It's not just a video, but these are the actual models of the robots. The code that is running the robots in the real world is what runs it in the omniverse. And so, again, once you've perfected this digital twin, you know it's going to work in reality. Yeah.
And Demi, I think that's some of the magic to make this happen is is the science. It's the truly the magic around connecting disparate twins together and applying complex system simulation. There's also the art part.
That's the part also just as incredibly fun as are our part around the then you talk about lighting, texturing, and as our animators and our 3D artists have been working closely with the OMNIVERSE team, that is also a place where a lot of the tech artists creative expression gets super powerful. So I want to just to kind of we have a few more minutes left. I want to just to also touch on a really important piece at a limited reality practice.
We call this the workforce augmented workforce experience. And by the end of the day, we talked a lot about in terms of the innovation, the kind of the amazing waves of new ways of doing work happening in workplace and doing workflow different. And you touched on ways by the planners, the designers, even in the manufacturing in the downstream, the crew not also participate. And that also includes your partners, your suppliers, your material providers. And what are some of the things that you've seen? And I'm happy to share what we're seeing around the whole workforce transformation driven by powered by the AI meets XR.
The enabling I think you see this to say I really being a an assistant right the robots we're not just doing these these robots that move sort of blindly but also cobots so I can enable humans to work side by side with robots and these, these machines, these devices are really an assistant. I think that whether it's on the design side, whether it's in the engineering side, whether it's not production side, whether it's in the marketing side, these these AI tools that generate AI helps. We have a system we call Picasso, and using voice or using written word, you can generate all kinds of scenes. And so if you're a marketer and you have your your car and you want to see what that car looks like in some of these driveway on a mountain road, on a country road, I can generate that I can create all kinds of different scenes and backgrounds to enhance that and make them more efficient in terms of designing the that marketing collateral, designing that website, I'm creating TV commercials for the cars. And again, we're talking about cars, but there's really a place that any product, any service, any industry can adopt this kind of technology. And to your point, you know, you were talking about sort of animation.
You would use to have all these different people working on different tasks as well. This whole system that brings everybody together, everyone can collaborate easily. You saw that in the video. You had people all over the world transported like a time machine to the same location. They can see that plant and they can view it from any angle. They can go inside, you know, and look around and talk about it and experiment.
And so these tools become extremely valuable, extremely helpful for optimizing whatever their workflow may be. Right. And also that extended to a 3D 3D consumption, right? So through augmented reality devices or virtual reality devices, we're helping our clients in terms of looking at a VR based training like technician. And this is becoming truly powerful.
And imagine with the complexity of what modern Digital Factory and that apply to in terms of how for, for example, passing on the knowledge base from the, the, the silver tsunami, addressing the silver tsunami off of the aging workforce into the younger generation. Right. So you're part of and then also there's augmented maintenance, etc.. The use cases are growing.
I think you're right. Once once we've built that model of the car, we all have thousands of parts coming together and the the home enthusiast who likes to tinker on his own vehicle can basically could go into VR. Right. Put a headset on or have their tablet and be able to open the hood and see all the different aspects of the car and work on the car that way. So I think the whole owner's manual experience or maintenance repair systems, professional or amateur, will benefit from all that. Exactly. And really democratize a lot of the complex and she care creating and create a lot more like this like IKEA did with the home furnishing. I think this technology is going to really democratize a lot of the engineering side.
I think even in an automotive space we're talking about safety is critical. So there are certain things that obviously we're not going to want consumers to be able to to modify. But yeah, if you're if you're doing any other kinds of design or or home furnishings or things like that, absolutely. Yeah.
So I know we're almost out of time, so I wanted to support a wrap with let's imagine, a year down the road. What would be the one or two things that you see different? I'm happy to share my one of the things that I see the industry might happen. Now, it's super exciting. We're working with hundreds of automakers, supply chain truck makers, robotaxi companies, sensor manufacturers. They're all building on Nvidia Drive. So we're the the AI brain of the car.
We're doing all the processing of the sensors and we have a full software stack. The cool thing now though, is that just like your iPhone or your Google phone, it gets better over time. You don't even have to buy a new device, right? The software updates add new features, new capabilities, and that's exactly what's happening in this area now, what is being called software defined cars.
So it's gone from fixed function to updates that enable new features. And so the cars get safer, they get more automated over time. And so a year from now, there isn't necessarily going to be any new huge revolution that's going to change things.
But those cars, those trucks, those robotaxis get better, more capable, their operating domains increase the types of features and functions that they have. The concierge can do more. So as we see more and more car companies adopting our drive platform as this centralized brain of the car, instead of a lot of different chips just spread throughout the vehicle, that brain is programable updatable over the air and those cars get better and better. Yeah, that's so sad. And to me, if I look a year down the road, I would say that a couple of things are one. Number one is the total cost of ownership of 3D content simulation should come down significantly and based on what I'm seeing in the ecosystem, the collective efforts around the ecosystem to lower the total cost of ownership and lower the adoption pain points.
And just as you said, the other side of the ROI equation, the benefits side is going to be more better realized when you have folks moving from policy to production to scale and into inverse of a functional workflow. So we hope to see a greater ROI In the second part. I see, and I fully start to see that happening today is more end to end process change and that truly when technology gets adopted, become unseen and unfolds becomes transparent, that's when the business process change is happening and we're seeing that real transformations happen. And so what.
Daniel, thank you for joining Deloitte Global Air, the conference and I also thanks everyone for tuning in into this segment. Thank you. It's great to be with you.
2023-05-20 12:55
