Recent

See all
NVIDIA H100.
Nov 08, 2024

5x Faster Time to First Token with NVIDIA TensorRT-LLM KV Cache Early Reuse

In our previous blog post, we demonstrated how reusing the key-value (KV) cache by offloading it to CPU memory can accelerate time to first token (TTFT) by up...
5 MIN READ
Nov 08, 2024

Transforming Telecom Networks to Manage and Optimize AI Workloads

5G global connections numbered nearly 2 billion earlier this year, and are projected to reach 7.7 billion by 2028. While 5G has delivered faster speeds, higher...
7 MIN READ
Screenshots of the Wandelbots NOVA interface.
Nov 07, 2024

Building Custom Robot Simulations with Wandelbots NOVA and NVIDIA Isaac Sim

Programming robots for real-world success requires a training process that accounts for unpredictable conditions, different surfaces, variations in object size,...
7 MIN READ
NeMo logo plus use case icons on a purple background.
Nov 06, 2024

State-of-the-Art Multimodal Generative AI Model Development with NVIDIA NeMo

Generative AI has rapidly evolved from text-based models to multimodal capabilities. These models perform tasks like image captioning and visual question...
6 MIN READ
Nov 06, 2024

Advancing Humanoid Robot Sight and Skill Development with NVIDIA Project GR00T

Humanoid robots present a multifaceted challenge at the intersection of mechatronics, control theory, and AI. The dynamics and control of humanoid robots are...
10 MIN READ
Nov 06, 2024

Spotlight: Galbot Builds a Large-Scale Dexterous Hand Dataset for Humanoid Robots Using NVIDIA Isaac Sim

Robotic dexterous grasping is a critical area of research and development, aimed at enabling robots to interact with and manipulate objects as flexibly as...
5 MIN READ
Nov 06, 2024

Spotlight: Fourier Trains Humanoid Robots for Real-World Roles Using NVIDIA Isaac Gym

This post was written in partnership with the Fourier research team. Training humanoid robots to operate in fields that demand high levels of interaction and...
4 MIN READ
Nov 05, 2024

Leverage AI Coding Assistants to Develop Quantum Applications at Scale with NVIDIA CUDA-Q

AI coding assistants have become ubiquitous across the software development landscape. Developers are increasingly using tools like GitHub Copilot, Amazon...
9 MIN READ
Nov 04, 2024

Discover New Biological Insights with Accelerated Pangenome Alignment in NVIDIA Parabricks

NVIDIA Parabricks is a scalable genomics analysis software suite that solves omics challenges with accelerated computing and deep learning to unlock new...
8 MIN READ
Nov 04, 2024

Frictionless Collaboration and Rapid Prototyping in Hybrid Environments with NVIDIA AI Workbench

NVIDIA AI Workbench is a free development environment manager that streamlines data science, AI, and machine learning (ML) projects on systems of choice. The...
10 MIN READ
Decorative image of icons and a molecular structure in green.
Nov 04, 2024

Build a Video Search and Summarization Agent with NVIDIA AI Blueprint

This post was originally published July 29, 2024 but has been extensively revised with NVIDIA AI Blueprint information. Traditional video analytics applications...
11 MIN READ
Image of an HGX H200
Nov 01, 2024

3x Faster AllReduce with NVSwitch and TensorRT-LLM MultiShot

Deploying generative AI workloads in production environments where user numbers can fluctuate from hundreds to hundreds of thousands – and where input...
5 MIN READ

Inference Performance

See all
NVIDIA H100.
Nov 08, 2024

5x Faster Time to First Token with NVIDIA TensorRT-LLM KV Cache Early Reuse

In our previous blog post, we demonstrated how reusing the key-value (KV) cache by offloading it to CPU memory can accelerate time to first token (TTFT) by up...
5 MIN READ
Image of an HGX H200
Nov 01, 2024

3x Faster AllReduce with NVSwitch and TensorRT-LLM MultiShot

Deploying generative AI workloads in production environments where user numbers can fluctuate from hundreds to hundreds of thousands – and where input...
5 MIN READ
Oct 28, 2024

NVIDIA GH200 Superchip Accelerates Inference by 2x in Multiturn Interactions with Llama Models

Deploying large language models (LLMs) in production environments often requires making hard trade-offs between enhancing user interactivity and increasing...
7 MIN READ
Oct 09, 2024

NVIDIA Grace CPU Delivers World-Class Data Center Performance and Breakthrough Energy Efficiency

NVIDIA designed the NVIDIA Grace CPU to be a new kind of high-performance, data center CPU—one built to deliver breakthrough energy efficiency and optimized...
8 MIN READ
Oct 09, 2024

Boosting Llama 3.1 405B Throughput by Another 1.5x on NVIDIA H200 Tensor Core GPUs and NVLink Switch

The continued growth of LLMs capability, fueled by increasing parameter counts and support for longer contexts, has led to their usage in a wide variety of...
8 MIN READ
Sep 26, 2024

Low Latency Inference Chapter 2: Blackwell is Coming. NVIDIA GH200 NVL32 with NVLink Switch Gives Signs of Big Leap in Time to First Token Performance

Many of the most exciting applications of large language models (LLMs), such as interactive speech bots, coding co-pilots, and search, need to begin responding...
8 MIN READ
Sep 24, 2024

NVIDIA GH200 Grace Hopper Superchip Delivers Outstanding Performance in MLPerf Inference v4.1

In the latest round of MLPerf Inference – a suite of standardized, peer-reviewed inference benchmarks – the NVIDIA platform delivered outstanding...
7 MIN READ
Image of an HGX H200
Sep 05, 2024

Low Latency Inference Chapter 1: Up to 1.9x Higher Llama 3.1 Performance with Medusa on NVIDIA HGX H200 with NVLink Switch

As large language models (LLMs) continue to grow in size and complexity, multi-GPU compute is a must-have to deliver the low latency and high throughput that...
5 MIN READ
Aug 28, 2024

Boosting Llama 3.1 405B Performance up to 1.44x with NVIDIA TensorRT Model Optimizer on NVIDIA H200 GPUs

The Llama 3.1 405B large language model (LLM), developed by Meta, is an open-source community model that delivers state-of-the-art performance and supports a...
7 MIN READ

Generative AI

See all
NVIDIA H100.
Nov 08, 2024

5x Faster Time to First Token with NVIDIA TensorRT-LLM KV Cache Early Reuse

In our previous blog post, we demonstrated how reusing the key-value (KV) cache by offloading it to CPU memory can accelerate time to first token (TTFT) by up...
5 MIN READ
Nov 06, 2024

Spotlight: Galbot Builds a Large-Scale Dexterous Hand Dataset for Humanoid Robots Using NVIDIA Isaac Sim

Robotic dexterous grasping is a critical area of research and development, aimed at enabling robots to interact with and manipulate objects as flexibly as...
5 MIN READ
Nov 06, 2024

Spotlight: Fourier Trains Humanoid Robots for Real-World Roles Using NVIDIA Isaac Gym

This post was written in partnership with the Fourier research team. Training humanoid robots to operate in fields that demand high levels of interaction and...
4 MIN READ
NeMo logo plus use case icons on a purple background.
Nov 06, 2024

State-of-the-Art Multimodal Generative AI Model Development with NVIDIA NeMo

Generative AI has rapidly evolved from text-based models to multimodal capabilities. These models perform tasks like image captioning and visual question...
6 MIN READ
Nov 05, 2024

Leverage AI Coding Assistants to Develop Quantum Applications at Scale with NVIDIA CUDA-Q

AI coding assistants have become ubiquitous across the software development landscape. Developers are increasingly using tools like GitHub Copilot, Amazon...
9 MIN READ
Nov 04, 2024

Discover New Biological Insights with Accelerated Pangenome Alignment in NVIDIA Parabricks

NVIDIA Parabricks is a scalable genomics analysis software suite that solves omics challenges with accelerated computing and deep learning to unlock new...
8 MIN READ
Nov 04, 2024

Frictionless Collaboration and Rapid Prototyping in Hybrid Environments with NVIDIA AI Workbench

NVIDIA AI Workbench is a free development environment manager that streamlines data science, AI, and machine learning (ML) projects on systems of choice. The...
10 MIN READ
Decorative image of icons and a molecular structure in green.
Nov 04, 2024

Build a Video Search and Summarization Agent with NVIDIA AI Blueprint

This post was originally published July 29, 2024 but has been extensively revised with NVIDIA AI Blueprint information. Traditional video analytics applications...
11 MIN READ
Image of an HGX H200
Nov 01, 2024

3x Faster AllReduce with NVSwitch and TensorRT-LLM MultiShot

Deploying generative AI workloads in production environments where user numbers can fluctuate from hundreds to hundreds of thousands – and where input...
5 MIN READ
Decorative image.
Oct 31, 2024

Build Multimodal Visual AI Agents Powered by NVIDIA NIM

The exponential growth of visual data—ranging from images to PDFs to streaming videos—has made manual review and analysis virtually impossible....
11 MIN READ
A robot making toast.
Oct 30, 2024

Teaching Robots to Tackle Household Chores

Robotics could make everyday life easier by taking on repetitive or time-consuming tasks. At NVIDIA GTC 2024, researchers from Stanford University unveiled...
2 MIN READ
Workflow diagram for the Innoplexus ADMET pipeline.
Oct 30, 2024

High Throughput AI-Driven Drug Discovery Pipeline

The integration of AI in drug discovery is revolutionizing the way researchers approach the development of new treatments for various diseases. Traditional...
6 MIN READ

Data Science

See all
NVIDIA H100.
Nov 08, 2024

5x Faster Time to First Token with NVIDIA TensorRT-LLM KV Cache Early Reuse

In our previous blog post, we demonstrated how reusing the key-value (KV) cache by offloading it to CPU memory can accelerate time to first token (TTFT) by up...
5 MIN READ
Nov 04, 2024

Discover New Biological Insights with Accelerated Pangenome Alignment in NVIDIA Parabricks

NVIDIA Parabricks is a scalable genomics analysis software suite that solves omics challenges with accelerated computing and deep learning to unlock new...
8 MIN READ
Nov 04, 2024

Frictionless Collaboration and Rapid Prototyping in Hybrid Environments with NVIDIA AI Workbench

NVIDIA AI Workbench is a free development environment manager that streamlines data science, AI, and machine learning (ML) projects on systems of choice. The...
10 MIN READ
Workflow diagram for disaggregating data into clusters and running in batches and merging.
Oct 31, 2024

Even Faster and More Scalable UMAP on the GPU with RAPIDS cuML

UMAP is a popular dimension reduction algorithm used in fields like bioinformatics, NLP topic modeling, and ML preprocessing. It works by creating a k-nearest...
12 MIN READ
A slide of breast cancer cells.
Oct 31, 2024

Deep Learning AI Model Identifies Breast Cancer Spread without Surgery

A new deep learning model could reduce the need for surgery when diagnosing whether cancer cells are spreading, including to nearby lymph nodes—also known as...
4 MIN READ
Oct 28, 2024

Supercharging Fraud Detection in Financial Services with Graph Neural Networks

Fraud in financial services is a massive problem. According to NASDAQ, in 2023, banks faced $442 billion in projected losses from payments, checks, and credit...
9 MIN READ
Oct 24, 2024

Bridging the CUDA C++ Ecosystem and Python Developers with Numbast

By enabling CUDA kernels to be written in Python similar to how they can be implemented within C++, Numba bridges the gap between the Python ecosystem and the...
8 MIN READ
Illustration representing drug discovery.
Oct 23, 2024

Optimizing Drug Discovery with CUDA Graphs, Coroutines, and GPU Workflows

Pharmaceutical research demands fast, efficient simulations to predict how molecules interact, speeding up drug discovery. Jiqun Tu, a senior developer...
2 MIN READ
Decorative image.
Oct 22, 2024

NetworkX Introduces Zero Code Change Acceleration Using NVIDIA cuGraph

NetworkX accelerated by NVIDIA cuGraph is a newly released backend co-developed with the NetworkX team. NVIDIA cuGraph provides GPU acceleration for popular...
7 MIN READ
A GIF of a hurricane forecast.
Oct 21, 2024

AI Accurately Forecasts Extreme Weather Up to 23 Days Ahead

New research from the University of Washington is refining AI weather models using deep learning for more accurate predictions and longer-term forecasts. The...
3 MIN READ
Oct 16, 2024

Scale High-Performance AI Inference with Google Kubernetes Engine and NVIDIA NIM

The rapid evolution of AI models has driven the need for more efficient and scalable inferencing solutions. As organizations strive to harness the power of AI,...
7 MIN READ
Decorative image.
Oct 15, 2024

Train Highly Accurate LLMs with the Zyda-2 Open 5T-Token Dataset Processed with NVIDIA NeMo Curator

Open-source datasets have significantly democratized access to high-quality data, lowering the barriers of entry for developers and researchers to train...
5 MIN READ

Robotics

See all
NeMo logo plus use case icons on a purple background.
Nov 06, 2024

State-of-the-Art Multimodal Generative AI Model Development with NVIDIA NeMo

Generative AI has rapidly evolved from text-based models to multimodal capabilities. These models perform tasks like image captioning and visual question...
6 MIN READ
Nov 06, 2024

Advancing Humanoid Robot Sight and Skill Development with NVIDIA Project GR00T

Humanoid robots present a multifaceted challenge at the intersection of mechatronics, control theory, and AI. The dynamics and control of humanoid robots are...
10 MIN READ
Nov 06, 2024

Spotlight: Galbot Builds a Large-Scale Dexterous Hand Dataset for Humanoid Robots Using NVIDIA Isaac Sim

Robotic dexterous grasping is a critical area of research and development, aimed at enabling robots to interact with and manipulate objects as flexibly as...
5 MIN READ
Decorative image of icons and a molecular structure in green.
Nov 04, 2024

Build a Video Search and Summarization Agent with NVIDIA AI Blueprint

This post was originally published July 29, 2024 but has been extensively revised with NVIDIA AI Blueprint information. Traditional video analytics applications...
11 MIN READ
A robot making toast.
Oct 30, 2024

Teaching Robots to Tackle Household Chores

Robotics could make everyday life easier by taking on repetitive or time-consuming tasks. At NVIDIA GTC 2024, researchers from Stanford University unveiled...
2 MIN READ
Oct 25, 2024

NVIDIA Showcases the Future of Intelligent Robots at CoRL 2024

From humanoids to policy, explore the work NVIDIA is bringing to the robotics community.
1 MIN READ
Oct 24, 2024

Powering the Next Wave of AI Robotics with Three Computers 

NVIDIA has built three computers and accelerated development platforms to enable developers to create physical AI.
1 MIN READ
Oct 22, 2024

How to Calibrate Sensors with MSA Calibration Anywhere for NVIDIA Isaac Perceptor

Multimodal sensor calibration is critical for achieving sensor fusion for robotics, autonomous vehicles, mapping, and other perception-driven applications....
9 MIN READ
Oct 22, 2024

A Beginner’s Guide to Simulating and Testing Robots with ROS 2 and NVIDIA Isaac Sim

Physical AI-powered robots need to autonomously sense, plan, and perform complex tasks in the physical world. These include transporting and manipulating...
10 MIN READ
Decorative image of a person looking at a monitor, which has multiple brain scans displayed.
Oct 16, 2024

Treating Brain Disease with Brain-Machine Interactive Neuromodulation and NVIDIA Jetson

Neuromodulation is a technique that enhances or restores brain function by directly intervening in neural activity. It is commonly used to treat conditions like...
4 MIN READ
Oct 14, 2024

Advancing Surgical Robotics with AI-Driven Simulation and Digital Twin Technology

The integration of robotic surgical assistants (RSAs) in operating rooms offers substantial advantages for both surgeons and patient outcomes. Currently...
4 MIN READ
An image of plants growing.
Sep 25, 2024

How AI and Robotics are Driving Agricultural Productivity and Sustainability

By 2030, John Deere aims for fully autonomous farming, addressing global challenges like labor shortages, sustainability, and food security. Their AI and...
2 MIN READ

Simulation / Modeling / Design

See all
Screenshots of the Wandelbots NOVA interface.
Nov 07, 2024

Building Custom Robot Simulations with Wandelbots NOVA and NVIDIA Isaac Sim

Programming robots for real-world success requires a training process that accounts for unpredictable conditions, different surfaces, variations in object size,...
7 MIN READ
Nov 06, 2024

Advancing Humanoid Robot Sight and Skill Development with NVIDIA Project GR00T

Humanoid robots present a multifaceted challenge at the intersection of mechatronics, control theory, and AI. The dynamics and control of humanoid robots are...
10 MIN READ
Nov 05, 2024

Leverage AI Coding Assistants to Develop Quantum Applications at Scale with NVIDIA CUDA-Q

AI coding assistants have become ubiquitous across the software development landscape. Developers are increasingly using tools like GitHub Copilot, Amazon...
9 MIN READ
A robot making toast.
Oct 30, 2024

Teaching Robots to Tackle Household Chores

Robotics could make everyday life easier by taking on repetitive or time-consuming tasks. At NVIDIA GTC 2024, researchers from Stanford University unveiled...
2 MIN READ
Oct 24, 2024

Bridging the CUDA C++ Ecosystem and Python Developers with Numbast

By enabling CUDA kernels to be written in Python similar to how they can be implemented within C++, Numba bridges the gap between the Python ecosystem and the...
8 MIN READ
Decorative image of seismic imaging.
Oct 24, 2024

Spotlight: Accelerating HPC in Energy with AWS Energy HPC Orchestrator and NVIDIA Energy Samples

The energy industry’s digital transformation requires a substantial increase in computational demands for key HPC workloads and applications. This trend is...
13 MIN READ
Oct 23, 2024

Accelerating Quantum Algorithms for Solar Energy Prediction with NVIDIA CUDA-Q and NVIDIA cuDNN

Improving sources of sustainable energy is a worldwide problem with environmental and economic security implications. Ying-Yi Hong, distinguished professor of...
7 MIN READ
Illustration representing drug discovery.
Oct 23, 2024

Optimizing Drug Discovery with CUDA Graphs, Coroutines, and GPU Workflows

Pharmaceutical research demands fast, efficient simulations to predict how molecules interact, speeding up drug discovery. Jiqun Tu, a senior developer...
2 MIN READ
Oct 22, 2024

A Beginner’s Guide to Simulating and Testing Robots with ROS 2 and NVIDIA Isaac Sim

Physical AI-powered robots need to autonomously sense, plan, and perform complex tasks in the physical world. These include transporting and manipulating...
10 MIN READ
A GIF of a hurricane forecast.
Oct 21, 2024

AI Accurately Forecasts Extreme Weather Up to 23 Days Ahead

New research from the University of Washington is refining AI weather models using deep learning for more accurate predictions and longer-term forecasts. The...
3 MIN READ
An array on MRI images.
Oct 17, 2024

AI Medical Imagery Model Offers Fast, Cost-Efficient Expert Analysis 

Researchers at UCLA have developed a new AI model that can expertly analyze 3D medical images of diseases in a fraction of the time it would otherwise take a...
4 MIN READ
Oct 16, 2024

Simulating Quantum Dynamics Systems with NVIDIA GPUs

Quantum dynamics describe how objects obeying the laws of quantum mechanics interact with their surroundings, ultimately enabling predictions about how matter...
7 MIN READ

Computer Vision / Video Analytics

See all
Decorative image of icons and a molecular structure in green.
Nov 04, 2024

Build a Video Search and Summarization Agent with NVIDIA AI Blueprint

This post was originally published July 29, 2024 but has been extensively revised with NVIDIA AI Blueprint information. Traditional video analytics applications...
11 MIN READ
Decorative image.
Oct 31, 2024

Build Multimodal Visual AI Agents Powered by NVIDIA NIM

The exponential growth of visual data—ranging from images to PDFs to streaming videos—has made manual review and analysis virtually impossible....
11 MIN READ
A slide of breast cancer cells.
Oct 31, 2024

Deep Learning AI Model Identifies Breast Cancer Spread without Surgery

A new deep learning model could reduce the need for surgery when diagnosing whether cancer cells are spreading, including to nearby lymph nodes—also known as...
4 MIN READ
Close-up shot of a wolf howling. Courtesy of Pexels/patrice schoefolt.
Oct 29, 2024

AI-Powered Devices Track Howls to Save Wolves

A new cell-phone-sized device—which can be deployed in vast, remote areas—is using AI to identify and geolocate wildlife to help conservationists track...
5 MIN READ
Decorative image.
Oct 24, 2024

Federated Learning in Autonomous Vehicles Using Cross-Border Training

Federated learning is revolutionizing the development of autonomous vehicles (AVs), particularly in cross-country scenarios where diverse data sources and...
10 MIN READ
Image of a car speeding on a road in the sunshine.
Oct 23, 2024

Optimizing the CV Pipeline in Automotive Vehicle Development Using the PVA Engine

In the field of automotive vehicle software development, more large-scale AI models are being integrated into autonomous vehicles. The models range from vision...
16 MIN READ
Oct 07, 2024

Accelerating Reality Capture Workflows with AI and NVIDIA RTX GPUs

Reality capture creates highly accurate, detailed, and immersive digital representations of environments. Innovations in site scanning and accelerated data...
10 MIN READ
Oct 07, 2024

Optimizing Microsoft Bing Visual Search with NVIDIA Accelerated Libraries

Microsoft Bing Visual Search enables people around the world to find content using photographs as queries. The heart of this capability is Microsoft's TuringMM...
11 MIN READ
Oct 07, 2024

Generate Image and Text Embeddings with NV-CLIP

NV-CLIP, a cutting-edge multimodal embeddings model for image and text, is now generally available.
1 MIN READ
Photo of an image scanner. Source: ORSI Academy.
Oct 07, 2024

Real-Time Surgical Guidance by Fusing Multi-Modal Imaging with NVIDIA Holoscan

Developers in the fields of image-guided surgery and surgical vision face unique challenges in creating systems and applications that can significantly improve...
7 MIN READ
An African farmer using an AI-powered chatbot on a cell phone asking a farming related question.
Sep 27, 2024

AI Chatbot Delivers Multilingual Support to African Farmers

Some of Africa’s most resource-constrained farmers are gaining access to on-demand, AI-powered advice through a multimodal chatbot that gives detailed...
4 MIN READ
An image of plants growing.
Sep 25, 2024

How AI and Robotics are Driving Agricultural Productivity and Sustainability

By 2030, John Deere aims for fully autonomous farming, addressing global challenges like labor shortages, sustainability, and food security. Their AI and...
2 MIN READ

Content Creation / Rendering

See all
Collage of 12 different car and background images.
Oct 07, 2024

Producing Cinematic Content at Scale with a Generative AI-Enabled OpenUSD Pipeline

Producing commercials is resource-intensive, requiring physical locations and various props and setups to display products in different settings and...
7 MIN READ
Oct 02, 2024

Accelerating LLMs with llama.cpp on NVIDIA RTX Systems

The NVIDIA RTX AI for Windows PCs platform offers a thriving ecosystem of thousands of open-source models for application developers to leverage and integrate...
5 MIN READ
Decorative image of GDN logo floating in a green cloud above a world map that has other gaming logos floating lower down.
Oct 01, 2024

Revolutionizing Cloud Gaming and Graphics Rendering with NVIDIA GDN

Gaming has always pushed the boundaries of graphics hardware. The most popular games typically required robust GPU, CPU, and RAM resources on a user’s PC or...
7 MIN READ
Oct 01, 2024

Simplify and Scale AI-Powered MetaHuman Deployment with NVIDIA ACE and Unreal Engine 5

At Unreal Fest 2024, NVIDIA released new Unreal Engine 5 on-device plugins for NVIDIA ACE, making it easier to build and deploy AI-powered MetaHuman characters...
4 MIN READ
Sep 23, 2024

Just Released: Free OpenUSD Training Courses

Accelerate your OpenUSD workflows with this free curriculum for developers and 3D practitioners.
1 MIN READ
Two images of the same person, one looking away from the camera (before) and one looking directly at the camera (after). A label in the lower right says Texel.
Sep 16, 2024

Orchestrating Innovation at Scale with NVIDIA Maxine and Texel

The NVIDIA Maxine AI developer platform is a suite of NVIDIA NIM microservices, cloud-accelerated microservices, and SDKs that offer state-of-the-art features...
5 MIN READ
Sep 11, 2024

Enabling Customizable GPU-Accelerated Video Transcoding Pipelines

Today, over 80% of internet traffic is video. This content is generated by and consumed across various devices, including IoT gadgets, smartphones, computers,...
10 MIN READ
GIF of live stream being modified by NVIDIA Holoscan for Media.
Sep 09, 2024

Transform Live Media Pipelines with NVIDIA Holoscan for Media

NVIDIA Holoscan for Media is now ready to be used in live production, taking advantage of the best of both networking and GPU technologies.  Holoscan for...
3 MIN READ
GIF of an image changing in response to the prompt.
Aug 30, 2024

Fast Inversion for Real-Time Image Editing with Text

Text-to-image diffusion models can generate diverse, high-fidelity images based on user-provided text prompts. They operate by mapping a random sample from a...
8 MIN READ
Still from the MechaBREAK game.
Aug 20, 2024

Deploy the First On-Device Small Language Model for Improved Game Character Roleplay

At Gamescom 2024, NVIDIA announced our first on-device small language model (SLM) for improving the conversation abilities of game characters. We also announced...
4 MIN READ
Image showing side by side comparison of person on webcam. Left side has the input with the user gazing off screen, the right side has the user’s background replaced with a scene of mountains and the user’s eyes are focused on the camera.
Aug 12, 2024

Elevating Video Communication with the NVIDIA Maxine AI Developer Platform and VideoRequest

Effective video communication is important for everyone who communicates online. For businesses, educators, and content creators, it is vital. NVIDIA Maxine is...
5 MIN READ
Jul 31, 2024

Shader Debugging Made Easy with NVIDIA Nsight Graphics

Shaders are specialized programs that run on the GPU that manipulate rays, pixels, vertices, and textures to achieve unique visual effects. With shaders, you...
8 MIN READ

Conversational AI

See all
GIF shows chat app in use.
Oct 28, 2024

Creating RAG-Based Question-and-Answer LLM Workflows at NVIDIA

The rapid development of solutions using retrieval augmented generation (RAG) for question-and-answer LLM workflows has led to new types of system...
11 MIN READ
Oct 23, 2024

Three Building Blocks for Creating AI Virtual Assistants for Customer Service with an NVIDIA NIM Agent Blueprint

In today's fast-paced business environment, providing exceptional customer service is no longer just a nice-to-have—it's a necessity. Whether addressing...
10 MIN READ
Oct 22, 2024

Scaling LLMs with NVIDIA Triton and NVIDIA TensorRT-LLM Using Kubernetes

Large language models (LLMs) have been widely used for chatbots, content generation, summarization, classification, translation, and more. State-of-the-art LLMs...
16 MIN READ
Oct 21, 2024

IBM’s New Granite 3.0 Generative AI Models Are Small, Yet Highly Accurate and Efficient

Today, IBM released the third generation of IBM Granite, a collection of open language models and complementary tools. Prior generations of Granite focused on...
5 MIN READ
NCNS logo on a black background.
Oct 16, 2024

Simplify AI Application Development with NVIDIA Cloud Native Stack

In the rapidly evolving landscape of AI and data science, the demand for scalable, efficient, and flexible infrastructure has never been higher. Traditional...
5 MIN READ
Avatars of a patient in a bed with a doctor sitting at a desk in another location, looking at a computer screen.
Oct 01, 2024

Evaluating Medical RAG with NVIDIA AI Endpoints and Ragas

In the rapidly evolving field of medicine, the integration of cutting-edge technologies is crucial for enhancing patient care and advancing research. One such...
11 MIN READ
Sep 26, 2024

Low Latency Inference Chapter 2: Blackwell is Coming. NVIDIA GH200 NVL32 with NVLink Switch Gives Signs of Big Leap in Time to First Token Performance

Many of the most exciting applications of large language models (LLMs), such as interactive speech bots, coding co-pilots, and search, need to begin responding...
8 MIN READ
Sep 25, 2024

Build a Digital Human Interface for AI Apps with an NVIDIA NIM Agent Blueprint

Providing customers with quality service remains a top priority for businesses across industries, from answering questions and troubleshooting issues to...
5 MIN READ
Sep 25, 2024

Deploying Accelerated Llama 3.2 from the Edge to the Cloud

Expanding the open-source Meta Llama collection of models, the Llama 3.2 collection includes vision language models (VLMs), small language models (SLMs), and an...
6 MIN READ
Sep 24, 2024

Accelerating Leaderboard-Topping ASR Models 10x with NVIDIA NeMo

NVIDIA NeMo has consistently developed automatic speech recognition (ASR) models that set the benchmark in the industry, particularly those topping the Hugging...
13 MIN READ
Sep 18, 2024

Quickly Voice Your Apps with NVIDIA NIM Microservices for Speech and Translation

NVIDIA NIM, part of NVIDIA AI Enterprise, provides containers to self-host GPU-accelerated inferencing microservices for pretrained and customized AI models...
11 MIN READ
Decorative image of a robot next to several NVIDIA icons.
Sep 17, 2024

Optimizing Data Center Performance with AI Agents and the OODA Loop Strategy

For any data center, operating large, complex GPU clusters is not for the faint of heart! There is a tremendous amount of complexity. Cooling, power,...
12 MIN READ

Edge Computing

See all
Close-up shot of a wolf howling. Courtesy of Pexels/patrice schoefolt.
Oct 29, 2024

AI-Powered Devices Track Howls to Save Wolves

A new cell-phone-sized device—which can be deployed in vast, remote areas—is using AI to identify and geolocate wildlife to help conservationists track...
5 MIN READ
Oct 24, 2024

Powering the Next Wave of AI Robotics with Three Computers 

NVIDIA has built three computers and accelerated development platforms to enable developers to create physical AI.
1 MIN READ
A GIF of a hurricane forecast.
Oct 21, 2024

AI Accurately Forecasts Extreme Weather Up to 23 Days Ahead

New research from the University of Washington is refining AI weather models using deep learning for more accurate predictions and longer-term forecasts. The...
3 MIN READ
Oct 16, 2024

Maximizing Energy and Power Efficiency in Applications with NVIDIA GPUs

As the demand for high-performance computing (HPC) and AI applications grows, so does the importance of energy efficiency. NVIDIA Principal Developer Technology...
2 MIN READ
Decorative image of a person looking at a monitor, which has multiple brain scans displayed.
Oct 16, 2024

Treating Brain Disease with Brain-Machine Interactive Neuromodulation and NVIDIA Jetson

Neuromodulation is a technique that enhances or restores brain function by directly intervening in neural activity. It is commonly used to treat conditions like...
4 MIN READ
Image of the GB200 NVL2 superchip.
Oct 08, 2024

Bringing AI-RAN to a Telco Near You

Inferencing for generative AI and AI agents will drive the need for AI compute infrastructure to be distributed from edge to central clouds. IDC predicts that...
14 MIN READ
Photo of an image scanner. Source: ORSI Academy.
Oct 07, 2024

Real-Time Surgical Guidance by Fusing Multi-Modal Imaging with NVIDIA Holoscan

Developers in the fields of image-guided surgery and surgical vision face unique challenges in creating systems and applications that can significantly improve...
7 MIN READ
An image of Antarctica with moss growing. Featured image credit Dr. Krystal Randall
Oct 03, 2024

AI Investigates Antarctica's Disappearing Moss to Uncover Climate Change Clues

Antarctica plays a crucial role in regulating ‌Earth’s climate. Most climate research into the world’s coldest, most windswept continent focuses on the...
5 MIN READ
An image of plants growing.
Sep 25, 2024

How AI and Robotics are Driving Agricultural Productivity and Sustainability

By 2030, John Deere aims for fully autonomous farming, addressing global challenges like labor shortages, sustainability, and food security. Their AI and...
2 MIN READ
Sep 24, 2024

Developing Next-Generation Wireless Networks with NVIDIA Aerial Omniverse Digital Twin

The journey to 6G has begun, offering opportunities to deliver a network infrastructure that is performant, efficient, resilient, and adaptable. 6G networks...
9 MIN READ
Photo of robot moving down a path.
Sep 23, 2024

Using Generative AI to Enable Robots to Reason and Act with ReMEmbR

Vision-language models (VLMs) combine the powerful language understanding of foundational LLMs with the vision capabilities of vision transformers (ViTs) by...
10 MIN READ
An image of a person working in a greenhouse.
Sep 11, 2024

AI Tool Helps Farmers Combat Crop Loss and Climate Change

Machine Learning algorithms are beginning to revolutionize modern agriculture. Enabling farmers to combat pests and diseases in real time, the technology is...
3 MIN READ

Data Center / Cloud

See all
Nov 08, 2024

Transforming Telecom Networks to Manage and Optimize AI Workloads

5G global connections numbered nearly 2 billion earlier this year, and are projected to reach 7.7 billion by 2028. While 5G has delivered faster speeds, higher...
7 MIN READ
Nov 04, 2024

Discover New Biological Insights with Accelerated Pangenome Alignment in NVIDIA Parabricks

NVIDIA Parabricks is a scalable genomics analysis software suite that solves omics challenges with accelerated computing and deep learning to unlock new...
8 MIN READ
Nov 04, 2024

Frictionless Collaboration and Rapid Prototyping in Hybrid Environments with NVIDIA AI Workbench

NVIDIA AI Workbench is a free development environment manager that streamlines data science, AI, and machine learning (ML) projects on systems of choice. The...
10 MIN READ
Oct 28, 2024

NVIDIA GH200 Superchip Accelerates Inference by 2x in Multiturn Interactions with Llama Models

Deploying large language models (LLMs) in production environments often requires making hard trade-offs between enhancing user interactivity and increasing...
7 MIN READ
Oct 24, 2024

Bridging the CUDA C++ Ecosystem and Python Developers with Numbast

By enabling CUDA kernels to be written in Python similar to how they can be implemented within C++, Numba bridges the gap between the Python ecosystem and the...
8 MIN READ
Decorative image of seismic imaging.
Oct 24, 2024

Spotlight: Accelerating HPC in Energy with AWS Energy HPC Orchestrator and NVIDIA Energy Samples

The energy industry’s digital transformation requires a substantial increase in computational demands for key HPC workloads and applications. This trend is...
13 MIN READ
Decorative image of a bot avatar poised between different processes.
Oct 24, 2024

Building AI Agents to Automate Software Test Case Creation

In software development, testing is crucial for ensuring the quality and reliability of the final product. However, creating test plans and specifications can...
15 MIN READ
Oct 16, 2024

Maximizing Energy and Power Efficiency in Applications with NVIDIA GPUs

As the demand for high-performance computing (HPC) and AI applications grows, so does the importance of energy efficiency. NVIDIA Principal Developer Technology...
2 MIN READ
Oct 16, 2024

Scale High-Performance AI Inference with Google Kubernetes Engine and NVIDIA NIM

The rapid evolution of AI models has driven the need for more efficient and scalable inferencing solutions. As organizations strive to harness the power of AI,...
7 MIN READ
NCNS logo on a black background.
Oct 16, 2024

Simplify AI Application Development with NVIDIA Cloud Native Stack

In the rapidly evolving landscape of AI and data science, the demand for scalable, efficient, and flexible infrastructure has never been higher. Traditional...
5 MIN READ
Oct 15, 2024

Future-Proof Your Networking Stack with NVIDIA DOCA-OFED

The NVIDIA DOCA software platform unlocks the potential of the NVIDIA BlueField networking platform and provides all needed host drivers for NVIDIA BlueField...
5 MIN READ
Image of the Supermicro JBOF on a black background.
Oct 15, 2024

Supermicro Launches NVIDIA BlueField-Powered JBOF to Optimize AI Storage

The growth of AI is driving exponential growth in computing power and a doubling of networking speeds every few years. Less well-known is that it’s also...
6 MIN READ