Advanced RAG Techniques for Telco O-RAN Specifications Using NVIDIA NIM Microservices
Mobile communication standards play a crucial role in the telecommunications ecosystem by harmonizing technology protocols to facilitate interoperability...
NVIDIA Grace CPU Delivers World-Class Data Center Performance and Breakthrough Energy Efficiency
NVIDIA designed the NVIDIA Grace CPU to be a new kind of high-performance, data center CPU—one built to deliver breakthrough energy efficiency and optimized...
Boosting Llama 3.1 405B Throughput by Another 1.5x on NVIDIA H200 Tensor Core GPUs and NVLink Switch
The continued growth of LLMs capability, fueled by increasing parameter counts and support for longer contexts, has led to their usage in a wide variety of...
Mistral-NeMo-Minitron 8B Model Delivers Unparalleled Accuracy
This post was originally published August 21, 2024 but has been revised with current data. Recently, NVIDIA and Mistral AI unveiled Mistral NeMo 12B, a leading...
Rapidly Triage Container Security with the Vulnerability Analysis NVIDIA NIM Agent Blueprint
Addressing software security issues is becoming more challenging as the number of vulnerabilities reported in the CVE database continues to grow at an...
Accelerate Large Linear Programming Problems with NVIDIA cuOpt
The evolution of linear programming (LP) solvers has been marked by significant milestones over the past century, from Simplex to the interior point method...
Inferencing for generative AI and AI agents will drive the need for AI compute infrastructure to be distributed from edge to central clouds. IDC predicts that...
Optimizing Microsoft Bing Visual Search with NVIDIA Accelerated Libraries
Microsoft Bing Visual Search enables people around the world to find content using photographs as queries. The heart of this capability is Microsoft's TuringMM...
Real-Time Surgical Guidance by Fusing Multi-Modal Imaging with NVIDIA Holoscan
Developers in the fields of image-guided surgery and surgical vision face unique challenges in creating systems and applications that can significantly improve...
Building LLM-Powered Production Systems with NVIDIA NIM and Outerbounds
With the rapid expansion of language models over the past 18 months, hundreds of variants are now available. These include large language models (LLMs), small...
Accelerating LLMs with llama.cpp on NVIDIA RTX Systems
The NVIDIA RTX AI for Windows PCs platform offers a thriving ecosystem of thousands of open-source models for application developers to leverage and integrate...
Revolutionizing Cloud Gaming and Graphics Rendering with NVIDIA GDN
Gaming has always pushed the boundaries of graphics hardware. The most popular games typically required robust GPU, CPU, and RAM resources on a user’s PC or...
Evolving AI-Powered Game Development with Retrieval-Augmented Generation
Game development is a complex and resource-intensive process, particularly when using advanced tools like Unreal Engine. Developers find themselves navigating...
Managing AI Inference Pipelines on Kubernetes with NVIDIA NIM Operator
Developers have shown a lot of excitement for NVIDIA NIM microservices, a set of easy-to-use cloud-native microservices that shortens the time-to-market and...
