Skip to content

Nemotron 3.5 Lightning now available on AI Gateway for free

,

Nemotron 3.5 Lightning from NVIDIA is now available for free on AI Gateway as nvidia/nemotron-3.5-lightning-free, served by NVIDIA.

Nemotron 3.5 Lightning is an open-weight reasoning and chat model for long-running agents, sub-agent work, chatbots, and RAG systems. The model has 30B parameters with 3B active per token, in a hybrid Mixture-of-Experts design that interleaves Mamba-2 and MoE layers with a few attention layers. It has a 1M token context window and supports tool calling and structured outputs.

Note: The provider may retain prompts for model improvement.

Call Nemotron 3.5 Lightning through the AI SDK, the Chat Completions, Responses, and Messages APIs, or a coding agent connected to AI Gateway.

Use nvidia/nemotron-3.5-lightning-free as the model name:

import { streamText } from 'ai';


const result = streamText({
  model: 'nvidia/nemotron-3.5-lightning-free',
  prompt: 'Write a TypeScript function that retries a failed fetch with exponential backoff.',
});
View model details

To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup:

npx vercel ai-gateway setup

Then select nvidia/nemotron-3.5-lightning-free in the agent. See the coding agents guide for details.

AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, budgets for API keys, routing rules, and more.

AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests.

You can view all language models available on AI Gateway.