News Summary
- NVIDIA Nemotron 3 models enable AI agents to engage in natural conversation, perform intricate reasoning, and leverage advanced visual features.
- NVIDIA, ISAAC, GR00T, N1.7, Alpamayo1.5, and Cosmos 3 improve physical AI reasoning and actions for robots and self-driving vehicles. (GR00T stands for Generalist Robot Reasoning Observation and Ontology Transformer. VLA means Visual and Language Action, which refers to processing and linking visual input, language, and actions in AI systems).
- The Proteina Complexa model in N-Media, BioNeMo speeds protein drug discovery. It includes a new dataset of millions of AI-protected protein complexes, created in collaboration with Google DeepMind, EMBL, and Seoul National University in the United States. Quality.
- Companies like CodeRabbit, CrowdStrike, Cursor, Factory, ServiceNow, and Perplexity use NVIDIA open models for agentic AI. LG Electronics and Milestone Systems use them for physical AI. Novo Nordisk, Viva Biotech, and Manifold Bio use them for healthcare and AI.
At GTC, NVIDIA announced the expansion of its model families, positioning these new models as foundational to the next generation of agentic physical and healthcare AI. This initiative is designed to help developers and scientists build intelligent systems that reason and act effectively in digital and real-world scenarios.
Open models are essential drivers of global innovation. NVIDIA’s expanding suite includes Nemotron (Agentic Systems), Cosmos (Physical AI), Alpamayo (Self-Driving Vehicles), ISAAC, GR00T (Robotics), and BioNemo (Biomedical research), all of which are central to unlocking new abilities across industries.
“Open source AI drives global innovation,” said Kari Vriski, Vice President of Generative AI Software at NVIDIA. NVIDIA’s open model families broaden intelligence across biology, robotics, and autonomous machines, empowering developers to build smart agents that advance both digital and physical industries.
NVIDIA, NemoTron 3, Ultra, Omni, and VoiceChat Models Power AI Agents
The NVIDIA NemoTron family now includes models for language, vision, voice, and safety, helping developers build specialized agentic AI.
NVIDIA, Nemotron 3 multimodal models support natural conversation, intricate reasoning, and advanced skills for AI agents.
- NEMOTRON 3 ULTRA offers advanced intelligence to boost productivity. The NVF P4 format (a data format developed by NVIDIA for efficient processing and storage) on the NVIDIA Blackwell platform delivers 5 times greater efficiency. Key benefits include support for AI-native applications such as coding assistance, faster research, and complex workflow automation.
- NEMOTRON 3-OMNI integrates audio, vision, and language, enabling AI agents to efficiently extract actionable insights from videos and documents, aiding decision-making and saving time.
- NEMOTRON 3 voice chat enables real-time conversations where AI can listen and respond simultaneously. It brings together speech recognition, language processing, and text-to-speech into a single system.
- Nemotrons, safety models, and retrieval tools enhance trust in the multimodal system. They detect unsafe content in text and images, and agentic retrieval improves the accuracy of results.
Langchain now uses NVIDIA, Nemotron models, and other NVIDIA Agent Toolkit software in its agent development platform. This helps businesses build, deploy, and monitor smart AI assistants that can automate complex tasks at scale.
Companies such as Automation Anywhere, Code Rabbit, CrowdStrike, Cursor, Factory, Distil, GenSpark, Perplexity, and ServiceNow use NVIDIA NemoTron models for advanced agentic applications. Edison Scientific applies NVIDIA NemoTron in Kosmos, an autonomous AI scientist that supports over 50,000 researchers in completing hundreds of research tasks simultaneously, significantly reducing months of work to a single day.
AI developers use NemoTron to create sovereign models for billions of people across languages and cultures. Organizations include AI Singapore, Bielik.AI, Indosat, Ooredoo, Hutchison, Linagora, Soofi, Stockmark, Trillian Labs, Viettel, and YTL AI Labs.
NVIDIA released Nemotron personas: privacy-focused synthetic datasets based on census and demographic data. The France dataset generated with Pleias is now available, along with datasets for the US, Japan, India, Brazil, and Singapore. NVIDIA also accelerates self-driving development with new models and simulation tools, helping robots and vehicles reason and act in the real world.
- NVIDIA Cosmos 3 the first world foundation model uniting world generation, physical AI reasoning, and action simulation arrives soon to help physical AI in complex settings.
- NVIDIA ISAC GR00TN1.7 is an open source reasoning vision-language-action (VLA) model, where VLA stands for Visual and Language Action, designed for humanoids. It is now ready for actual use.
- NVIDIA Alpamayo 1.5 is a VLA model that boosts autonomous vehicle reasoning, offering navigation guidance, prompt conditioning, flexible multi-camera support, and adjustable camera settings.
At GTC, NVIDIA CEO Jensen Huang previewed GR00T-N2, a next-generation robot foundation model based on Dream Zero research. GR00T-N2 completes new tasks in new environments over twice as often as top VLA models. It leads in Malmo Spaces and RoboArena for generalist robot policies and is expected by year’s end.
Companies like HCL Tech, Johnson & Johnson, MedTech, Milestone Systems, Mimic Robotics, Skilled AI, Tulip, and Toyota Research Institute use NVIDIA Cosmos to accelerate physical AI training and video analytics. Humanoid LG Electronics Neura and Noble machines use NVIDIA ISAC GR00T N1.7 for deploying humanoid robots.
Open Models Accelerate Healthcare and Life Sciences Research
NVIDIA is advancing AI-driven discovery in healthcare and life sciences with open, multimodal-based models and datasets. These tools speed up biomedical research, drug discovery, medical imaging, and the understanding of scientific literature and life sciences, helping researchers develop new knowledge and model, design, and simulate biological systems at scale.
Proteina-Complexa is a generative model for designing protein binders, speeding up structure-based drug discovery and therapy development. NOVO, Nordisk, Viva Biotic, and Manifold Bio use it to design and test proteins that bind to target proteins.
NVIDIA worked with EMBL, Google DeepMind, and Seoul National University to expand the AlphaFold protein structure database, adding about 30 million protein-complex predictions, including 1.7 million high-confidence entries. This accelerates drug-target discovery and understanding of disease biology.
NVIDIA also launched NVQSP, a GPU-accelerated simulation engine that allows pharmaceutical researchers to test many more treatment scenarios in computer models before clinical trials. In tests, it was up to 77 times faster than traditional single-threaded CPU simulations, letting some scientists analyze hundreds of treatment levels and patient groups in the time it used to take to simulate just a few.
Availability
Some NVIDIA open models, data, and frameworks are available on GitHub, Hugging Face, various cloud and AI platforms, and build.nvidia.com.
Many models are also offered as NVIDIA NIM microservices. These enable secure, scalable deployment across any NVIDIA-accelerated infrastructure, from edge devices to the cloud.
Source: NVIDIA Expands Open Model Families to Power the Next Wave of Agentic, Physical and Healthcare AI
