Shilpa Kolhatkar

Given this surge in AI-related revenue for Broadcom, how might this impact the demand and pricing for Nvidia's high-end chips used in AI applications? https://lnkd.in/d4Z5SMj4

2

With NVIDIA NIM and NIM Agent Blueprints, medical researchers across the public sector can jump-start their adoption of state-of-the-art, optimized #AI models to accelerate their work. #healthcare #hc-digitalhealth

3

Check out how the world’s first #generativeAI models for #OpenUSD development will be available as NVIDIA NIM microservices.

76

🚀 NVIDIA NIM on Bedrock Marketplace 🚀 We’re thrilled to announce that NVIDIA NIM are now available on Amazon Bedrock Marketplace, SageMaker JumpStart, and AWS Marketplace. With this expansion, developers can now deploy high-performance, NVIDIA-optimized inference solutions for generative AI models across key AWS services, delivering: ✅ Faster AI inference ✅ Lower latency ✅ Cost efficiency From Meta’s Llama 3 to NVIDIA Nemotron and more, over 100 prebuilt NIM microservices are now at your fingertips. Tailored for scalability and secure deployment, NIM brings unmatched performance to models running on EC2, EKS, SageMaker, and Amazon Bedrock. This collaboration between NVIDIA and AWS accelerates innovation across industries, from healthcare to manufacturing, ensuring enterprises can meet the growing demand for generative AI applications. 💡 Ready to unlock the power of NVIDIA NIM on AWS? Explore the catalog, request a developer license, or start a 90-day NVIDIA AI Enterprise trial to experience the difference firsthand. Another great project by this wonderful team! Abhishek Sawarkar Jiahong Liu Kshitiz Gupta Timothy Ma Saurabh Trikande Charlie Huang Rohil Bhargava Let’s power the next wave of AI together! #GenerativeAI #NVIDIA #AWS #Bedrock #AIInference #AWSreInvent2024

44

1 Comment

As AI grows, so does its demand for power. NVIDIA AI's director of accelerated computing, Dion Harris, and Penn Engineering expert Benjamin Lee discuss ways to minimize AI energy demand and grid impact in the new episode of the Energy Policy Now podcast.

4

⚡ Accelerate the performance of your scientific computing workflows, enabling quicker simulations in robotics, fluid dynamics, and digital twins 📣 Just released: NVIDIA Warp 1.5, a new open-source #Python framework for #CUDA acceleration.

7

🌟 New from #NVIDIAResearch: Weight-Decomposed Low-Rank Adaptation (DoRA). A groundbreaking advancement in fine-tuning technology that's set to revolutionize how we optimize pretrained models without increasing inference costs. 👀 https://dy.si/RHXiT

13

Blackwell 26,596 times more powerful than our 8 Intel MOSIPS? At Computex 2024, Jensen Huang unveiled the roadmap for Blackwell, promising a future of accelerated computing architectures that redefine our expectations. These advancements are set to elevate AI capabilities to unprecedented levels. Our A7Technology MOSIPS system, powered by 8 Intel NUC computers, delivers 752 GFLOPS, with each system offering 94 GFLOPS. This impressive setup, however, pales in comparison to the capabilities of the new Blackwell B200 GPU. The B200 not only doubles the transistor count of the current H100 but also delivers an astounding 20 petaflops of AI performance from a single GPU, compared to the H100's 4 petaflops. The B200's 192GB of HBM3e memory and 8 TB/s bandwidth are equally impressive, showcasing how scaling is driving AI capabilities to new heights. This leap in performance is a significant phase shift, surpassing the limits of Moore's law and pushing the boundaries of what we thought possible with CPU architectures. To put this in perspective, a single Blackwell B200 GPU's 20 petaflops make it approximately 26,596 times more powerful than our current system's 752 GFLOPS, which uses eight of the latest Intel CPUs. These breakthroughs in parallel architectures are not just incremental improvements; they represent a monumental leap in AI capability and power, setting the stage for the next era of technological advancement.

1

Over 40 #healthcare and life sciences startups and enterprises are leveraging Meta Llama 3 NIM to develop and deploy applications that accelerate digital biology, digital surgery, and #digitalhealth 🧬 Learn more about use cases for NVIDIA NIM inference microservices in the blog >

9

On Market View today: Broadcom’s better than expected Q4 profit; Amazon donates US$1M to Trump’s inaugural fund; China’s Central Economic Work Conference; US wholesale inflation accelerates unexpectedly; Keppel DC Reit’s preferential offering 159.9% oversubscribed; South Korean equities ahead of second impeachment vote Singapore stocks slipped into the negative territory this morning, after China deepened its stimulus drive in a bid to brace itself for trade tensions with the United States. In early trade, the Straits Times Index (STI) fell 0.2 per cent to 3,803.55 points after 21.4 million securities changed hands in the broader market. In terms of counters to watch, we have Keppel DC Real Estate Investment Trust, after its manager announced yesterday that the Reit’s non-renounceable preferential offering was about 159.9 per cent subscribed. Elsewhere, from a quick look at developments out of China’s annual Central Economic Work Conference, to how Chip supplier Broadcom posted better-than-expected profit in the fourth quarter on the back of growing AI computing demand, more corporate and international headlines remain in focus. Also on deck – what to watch in the US after the country’s wholesale inflation unexpectedly accelerated in November. Plus – volatilities in South Korea as investors’ focus there turns to a second impeachment vote of President Yoon Suk Yeol planned for tomorrow. Glad to unpack the key movements of the day with Juncheong Too (涂骏祥), Assistant Dealing Manager from Moomoo SG. Catch the podcast episode on Awedio, Apple podcast and Spotify at the links below. Podcast links: https://lnkd.in/gF_5NMSt https://lnkd.in/d2cbuvcM https://lnkd.in/duppfFyN Gavin Chia #singapore #sgx #sti #stockmarket #us #inflation #tightening #cooling #federalreserve #fed #interestrates #ratecut #ppi #wholesaleprice #acceleration #producerpriceindex #broadcom #earnings #artificialintelligence #ai #amazon #donation #trump #china #centraleconomicworkconference #keppeldcreit #preferentialoffering #oversubscribed #southkorea #second #impeachment #vote

21

3 Comments

Great discussion on computing at a main stage Fortune Brainstorm AI panel with CEO of Cerebras Systems Andrew Feldman and CEO of Alterra Sandra Rivera, moderated by Fortune AI Reporter Sharon Goldman. The topic was Chipping Away at the Competition and, no surprise, we’re all in agreement that competition is required to advance innovation in chip solutions. Check out this short clip capturing our points of view.  The full 22-minute discussion will be live on https://lnkd.in/gJKBmG6M in the coming days. 

199

5 Comments

PiLogic has developed an AI modeling methodology that allows simplification of AI training using known structure in the data and the system being modeled.  This allows faster training and inference where such structure  exists and reduces energy consumption for many essential problems being addressed by advanced AI.

38

NVIDIA kicked off #SC24 with a wave of AI and #supercomputing tools, set to revolutionize industries from biopharma to climate science.

8

Take the new self-paced course on NVIDIA NIM, a set of easy-to-use microservices designed for secure, reliable deployment of high-performance #AI model inferencing across the #cloud, #datacenter, and #workstations. Enroll now ➡️ bit.ly/3Zu5xEb Learn important concepts to understand how NIM enables the building, deploying, and scaling of AI applications.

12

1 Comment

What an incredible milestone for everyone at Google Quantum AI!  🤩 👏 Willow, our newest quantum chip, performed a computation in one minute that would take 10 septillion years on one of the most powerful supercomputers today. To put that into perspective, that’s 10,000,000,000,000,000,000,000,000 years!  Hartmut Neven, Founder and Lead at Google Quantum AI, explains all the technical details much better than I can. So, if you’re curious about Willow—what it is, how it works, and what this means—definitely check out latest blog on this remarkable achievement 👉  https://lnkd.in/eWWgkjPX

264

3 Comments

Our blog post on the Google keynote at OCP is live now: Collaborating on the compute infrastructure of the future: sustainable silicon to intelligent clouds. +Amber Huffman https://lnkd.in/gytPAz_v #googlecloud #ocp

161

3 Comments