Dinesh Narayanan

Very good interview with Avijit Sinha, President of Wind River and Amazon Web Services (AWS) at their #reinvent event, on the importance of #edgeAI and their investment in this area - including a nice shout out for EDGE AI FOUNDATION …! Bill Podrasky Efren Mercado Michael Kuptz Rosina Haberl Evgeni Gousev Walter Sullivan Sandeep Modhvadia

19

I heard two recent quotes from Microsoft and NVIDIA CEOs last week and it made me reflect on the likely role and landscape for the CIO and IT function in the next 5 years? Jensen Huang – CEO, NVIDIA: “Your IT Department is going to become kinda like IT Agent HR” Satya Nadella – CEO, Microsoft: “The business logic [currently in SaaS platforms] is all going to these AI agents. They’re not going to discriminate between what the backend is - they’ll update multiple databases, and all the logic will be in the AI tier.” If you apply and combine these perspectives I see this as adding to and tweaking the things that technology functions will do, not fundamentally changing them. See below for why… Many organisations will probably still have pockets of on-premise infrastructure to run and maintain, they will still have a number of core business platforms, mostly cloud-based. Maybe some of those will have their own AI agents, maybe some will be stripped back to their core databases as Nadella predicts. That would still require CIOs and their teams to: - Manage relationships with the business to give them what they need - Develop and own architectural and data roadmaps, with added focus on AI - Own, deliver and support service management activities and delivery toolsets (e.g. ITSM, CI/CD and DevSecOps) with added focus on AI tools as part of this ecosystem. - Orchestrate the effective sourcing and management of suppliers, with additional AI offerings. - Orchestrate the skills and resources required to augment business capabilities (in product teams) and also to deliver the evolving capabilities they require within IT. It might also mean they do more to: - Provide guardrails and support the business in buying and run its own AI agents, in the same way that a wave of governance followed the proliferation and ubiquity of cloud. - Provide greater leadership on architecture and roadmaps (including data and AI) given the increasing blur between applications, integration/middleware and databases - Manage the risks that these shifts present through increasingly complex service management arrangements and heightened cyber risk So, if you look at the two lists above, it covers many of the key facets most CIOs would say they do today - BRM, Architecture, Change/Transition, Service Management, Sourcing, Risk Management, Governance and People . So in some ways different, but in some, just the same? What do you think? If you’re wrestling with what AI means for your business and technology function, reach out to me or the Mozaic team for an informal conversation… #mozaic #servicemanagement #cio #cto #cdo #digital #technology #ai #consulting #itom #operatingmodel #platforms #microsoft #nvidia Steve Tuppen David Courtley Simon Odell Matt Gray Russell Smith Christopher Fisher Mozaic Services Limited

8

1 Comment

I'm always happy and proud to hear our early investors at REFASHIOND Ventures: The Industrial Transformation Fund talk about the work they are doing. Each of them is having real impact in building supply chains for tomorrow. In this podcast Zac talks about the underlying infrastructure for what what I describe as Information and Data Supply Chains. This is worth listening to if you want to get into some of the issues that will determine the future of Physical Supply Chains. #TWSCF #TNYSCM | The past ran on supply chains. The present runs on supply chains. The future will run on supply chains. The world is a supply chain.®

4

Blackwell 26,596 times more powerful than our 8 Intel MOSIPS? At Computex 2024, Jensen Huang unveiled the roadmap for Blackwell, promising a future of accelerated computing architectures that redefine our expectations. These advancements are set to elevate AI capabilities to unprecedented levels. Our A7Technology MOSIPS system, powered by 8 Intel NUC computers, delivers 752 GFLOPS, with each system offering 94 GFLOPS. This impressive setup, however, pales in comparison to the capabilities of the new Blackwell B200 GPU. The B200 not only doubles the transistor count of the current H100 but also delivers an astounding 20 petaflops of AI performance from a single GPU, compared to the H100's 4 petaflops. The B200's 192GB of HBM3e memory and 8 TB/s bandwidth are equally impressive, showcasing how scaling is driving AI capabilities to new heights. This leap in performance is a significant phase shift, surpassing the limits of Moore's law and pushing the boundaries of what we thought possible with CPU architectures. To put this in perspective, a single Blackwell B200 GPU's 20 petaflops make it approximately 26,596 times more powerful than our current system's 752 GFLOPS, which uses eight of the latest Intel CPUs. These breakthroughs in parallel architectures are not just incremental improvements; they represent a monumental leap in AI capability and power, setting the stage for the next era of technological advancement.

1

Join us on August 29 at 9am PT | 12pm ET for an exclusive webinar with NVIDIA. We’ll dive into fine-tuning LLMs and deploying them at scale—securely and cost-effectively—across any infrastructure. You’ll Gain insight on: 💡 Efficiency boosts with NVIDIA NIM 🔧 Optimized resource use and performance 🧠 Advanced model training with NVIDIA NeMo 📈 Scalable deployment strategies 👉 Don’t miss out—reserve your spot now! <https://gag.gl/rJT3Xq> #AI #MachineLearning #Webinar #NVIDIA

1

Multi cloud GenAI needs, with all the building blocks for modern applications, from MongoDB...

10

Discover why the future of software demands a shift towards GPU acceleration. Read Rodrigo Aramburu's latest insights on why traditional CPUs no longer make the cut. #AI #DataAnalytics #GPU #TechInnovation #FutureOfTech #TechTrends #AIRevolution #MachineLearning #DataScience #TechAcceleration #NextGenTech #TechInsights #FutureProof #AIandData #InnovationInTech

6

1 Comment

YES! Thanks, Dean Takahashi, VentureBeat, for covering NVIDIA's Inference Microservices (NIMs), including those powered by partners such as Domino Data Lab. Excited to innovate jointly with NVIDIA on an #AI form factor that makes it even easier to deploy, manage, and scale models built in #DominoDataLab on #NVIDIA's infrastructure Here's the article: https://gag.gl/fxt56p #GenerativeAI #GenAI #ResponsibleAI #datascience #MachineLearning #ml #mlops #Innovation #EnterpriseAI #AIatscale

3

Great article on how San Francisco is leaning in and leveraging its vast wealth of innovative thinkers, tech intensity, and vast learning and funding resources. San Francisco Chamber of Commerce is doing an amazing job embracing the next wave! Rodney Fong Anita LW Huang Katy Brown #Microsoft #AzureAI #Startups #AI

71

1 Comment

Last April I gave a talk at Palo Alto Networks about AI's impact on enterprise software. I didn't know Satyam Sinha, their VP of Engineering, was in the audience—and he'd been thinking about this for months. He soon resigned and shifted focus to building a startup that would push AI innovation forward instead of simply adapting to it. Fast forward to today: My partner Jaya and I are thrilled to announce that Acuvity, the company born from Satyam's vision, has raised a $9M seed round led by Foundation Capital, with participation from Jonathan Siddharth (CEO of FC portfolio company Turing) and other angels. Acuvity tackles one of the most pressing issues in enterprise AI adoption—security. Companies rushing to leverage AI are exposing themselves to unprecedented risks of data leaks and compliance violations. Samsung's recent AI-related data breach is not an anomaly. Satyam and his co-founder Antoine Mercadal have developed a novel approach using AI models to monitor AI usage, combining elements of classical machine learning with LLMs. It's an elegant solution to a complex problem, providing enterprises with the visibility and control they desperately need. This investment combines two of Foundation's deep convictions: the transformative power of AI and the critical importance of data security. We've been investing at this intersection for over a decade, from MobileIron to Fortanix to Skyflow. We're excited to lead this round and partner with Satyam, Antoine, and the entire Acuvity team on their journey to secure AI-powered enterprise! Read more: https://lnkd.in/gPiiutpD

169

8 Comments

Great work by the team producing this collection of assets on how to use NVIDIA NIM on AWS to optimize your inference performance to get state-of-the-art deployments. Running inference endpoints across Amazon's NVIDIA GPUs instances on EC2, Amazon EKS, and Amazon SageMaker has never been faster or more efficient. Here’s why NVIDIA NIM is the best solution for AI developers and enterprises: ✅ Lightning-fast Deployment: Prebuilt containers with optimized generative AI models, deployable with just a few commands, help you get started in minutes. ✅ Unparalleled Performance: Experience up to 2.5x higher throughput, 4x faster time-to-first-token, and 2.2x faster inter-token latency compared to other open-source solutions—because speed and efficiency matter when scaling AI. ✅ Seamless Integration with AWS: NIM is purpose-built to integrate with AWS managed services like EKS, EC2, and SageMaker, providing a streamlined path from development to production, no matter where your AI models run. ✅ Enterprise-Grade Security and Flexibility: Maintain full control of your data, IP, and custom models while scaling AI workloads in a secure and enterprise-ready environment. ✅ Cost-Effective and Scalable: Reduce time-to-market and operational costs, optimizing response times and throughput, all while leveraging the robust infrastructure of AWS. Whether you’re deploying large language models or domain-specific AI, NVIDIA NIM on AWS empowers you to deliver high-performance AI applications, bringing vision to reality at scale. #GenerativeAI #AIinference #NVIDIANIM #AWS #EC2 #EKS #SageMaker #AI https://lnkd.in/e722U8Np Abhishek Sawarkar Brian Pickering Guy Farber Adel El Hallak Jiahong Liu Timothy Ma Saurabh Trikande Vara Bonthu

117

3 Comments

🚀 Exciting news! #Cohesity adopts NVIDIA NIM to supercharge retrieval augmented generation apps for enterprises. 🚀 This collaboration enhances #AI capabilities: 1️⃣ Faster deployment of generative AI models 2️⃣ Streamlined development with prebuilt microservices 3️⃣ Accelerated AI innovation for your enterprise

1

What an incredible milestone for everyone at Google Quantum AI!  🤩 👏 Willow, our newest quantum chip, performed a computation in one minute that would take 10 septillion years on one of the most powerful supercomputers today. To put that into perspective, that’s 10,000,000,000,000,000,000,000,000 years!  Hartmut Neven, Founder and Lead at Google Quantum AI, explains all the technical details much better than I can. So, if you’re curious about Willow—what it is, how it works, and what this means—definitely check out latest blog on this remarkable achievement 👉  https://lnkd.in/eWWgkjPX

264

3 Comments

A wonderful nonprofit super advanced, highly secure AI based platform not driven by ads, or special interest, but majority of the informed society. A first real step to allow people to build up trust, by their deeds and actions. The platform will use AI to eliminate misinformation, AI bots, information overload, and enforce transparency & truth. Each person on this platform is real, has a unique global ID and alive on the network and they can express their political views under either a unique anonymous avatars without fear, or choose their real information. The ultimate goal is to percolate up Trusted leaders, as they buildup their trust worthiness credentials that can advance their society or their cause to make their society and eventually planet earth a better place for all, regardless of gender , race or religion, etc. Please support this nonprofit platform to build a better future for your children and future genertations.

1

Looking forward to this talk with Todd Brannon and Chris O'Brien. As the speed of generative AI adoption continues to grow, we'll look at what IT teams need to know in supporting these new workloads in their environment. Don't miss this one! #generativeAI #AImanagement #AIatscale

10

Most people, when interested, know how to break down a problem into its constituent parts. The #SmartAgent disruption of the #Software industry ultimately means broader participation in solution automation encoded in software, in a Lego-like fashion, using #AI-based agents. The link below denotes a segment from the recent Computex 2024 presentation by NVIDIA's Jensen Huang, where he expresses his take on this major software industry disruption. https://lnkd.in/eeFxev_z about the topic above. #Disruption #Software #Industry