NVIDIA unveiled foundation models designed to run locally on NVIDIA RTX AI PCs at CES 2025, unlocking transformative possibilities in digital humans, content creation, productivity, and software development. This marks a significant shift by bringing the power of generative AI directly to users, reinforcing NVIDIA’s commitment to making AI more accessible.
GeForce: Pioneering AI Innovation -
The GeForce platform has been at the forefront of AI development for over a decade. In 2012, the groundbreaking AlexNet, the first GPU-accelerated deep learning network, was trained on the GeForce GTX 580. Last year, over 30% of published AI research papers cited the use of GeForce RTX, underscoring its lasting influence in the AI domain.
Empowering Enthusiasts and Developers with Generative AI -
NVIDIA is democratizing AI development with RTX AI PCs and new tools for users of all skill levels. Low-code and no-code platforms like AnythingLLM, ComfyUI, Langflow, and LM Studio provide user-friendly interfaces, making complex AI models accessible to enthusiasts and developers alike.
To further streamline AI integration, NVIDIA has introduced NIM microservices, enabling seamless connections to popular graphical user interfaces and simplifying access to cutting-edge generative AI models. Additionally, NVIDIA AI Blueprints, built on NIM microservices, offer preconfigured workflows tailored for applications such as digital humans and content creation.
This latest development signals a new era where the power of AI becomes accessible to a wider audience, enabling innovative use cases across various industries.
Expanding the RTX AI Ecosystem -
To address growing demand, all major PC manufacturers and system builders are introducing NIM-ready RTX AI PCs. These systems will integrate NIM microservices and support NVIDIA Project DIGITS, a personal AI supercomputer powered by the new NVIDIA GB10 Grace Blackwell Superchip. Boasting a petaflop of AI computing performance, Project DIGITS is designed to empower researchers, data scientists, and students to prototype, fine-tune, and run large AI models effectively.
Project DIGITS will launch in May, priced starting at $3,000 (approximately ₹2,57,060), and will be available directly from NVIDIA and its top partners.
Foundation Models: Making AI NIMble -
Foundation models, the backbone of generative AI, are neural networks trained on vast datasets. NVIDIA is launching a robust pipeline of NIM microservices for RTX AI PCs, featuring contributions from prominent developers like Black Forest Labs, Meta, Mistral, and Stability AI. These microservices will cater to a wide array of applications, including:
- Large Language Models (LLMs)
- Vision-Language Models
- Image Generation
- Speech Processing
- Embedding Models for Retrieval-Augmented Generation (RAG)
- PDF Extraction
- Computer Vision
In addition, NVIDIA unveiled the Llama Nemotron family of open models, known for their exceptional accuracy across diverse agentic tasks. The Llama Nemotron Nano model, available as a NIM microservice for RTX AI PCs and workstations, will excel in tasks such as instruction following, function calls, chat, coding, and math.
NIM microservices are optimized for deployment across NVIDIA GPUs, ensuring consistent and seamless performance whether on RTX PCs, workstations, or in the cloud. This ecosystem expansion positions NVIDIA at the forefront of enabling advanced AI capabilities for professionals and enthusiasts alike.
Streamlined Development and Deployment -
Developers and enthusiasts can easily download, set up, and run NIM microservices on Windows 11 PCs using Windows Subsystem for Linux (WSL). These microservices are compatible with popular AI development and agent frameworks such as AI Toolkit for VSCode, AnythingLLM, ComfyUI, CrewAI, Flowise AI, LangChain, Langflow, and LM Studio. This compatibility allows seamless connection of applications and workflows to AI models running on NIM microservices via industry-standard endpoints, creating a unified interface across platforms.
Additionally, enthusiasts will soon have access to a variety of NIM microservices through the upcoming NVIDIA ChatRTX tech demo release.
Project R2X: Bringing AI Agents to Life -
NVIDIA introduced Project R2X, a vision-enabled PC avatar designed to demonstrate the potential of NIM in building AI agents and assistants. This advanced AI avatar can:
- Provide instant access to information.
- Assist with desktop applications and video conference calls.
- Read and summarize documents.
R2X leverages NVIDIA RTX Neural Faces, a generative AI algorithm, and is animated by the diffusion-based NVIDIA Audio2Face™-3D model, offering enhanced lip and tongue movement. The avatar integrates with cloud AI services like OpenAI’s GPT-4o and xAI’s Grok, alongside NIM microservices and AI Blueprints, through frameworks like CrewAI, Flowise AI, and Langflow. Users can sign up for updates on Project R2X.
AI Blueprints: Ready-to-Use Workflows for PCs -
NIM microservices will also be available through AI Blueprints, preconfigured AI workflows designed for local execution on RTX PCs. These blueprints enable developers to create diverse applications, including:
- PDF to Podcast: Extracts text, images, and tables from a PDF to generate an editable podcast script. It can produce a full audio recording using various voices or even a user’s voice sample. Users can also engage in real-time conversations with the AI podcast host to explore specific topics in detail.
- 3D-Guided Generative AI: Allows artists to control image generation using simple 3D objects arranged in a 3D renderer like Blender. This blueprint enables precise composition control during the AI image generation process.
Availability -
NVIDIA NIM microservices and AI Blueprints will be available starting in February 2025. NIM-ready RTX AI PCs will be launched by major manufacturers, including Acer, ASUS, Dell, GIGABYTE, HP, Lenovo, MSI, Razer, Samsung, and others, along with system builders.
This milestone represents a transformative leap in democratizing AI. By enabling local execution of foundation models on RTX AI PCs, NVIDIA is unlocking unprecedented opportunities for AI-powered creativity, productivity, and development—limited only by the imagination of users and developers.
