Open-source AI infrastructure

Llama 3.3 70B Instruct on NVIDIA NIM

Review Llama 3.3 70B Instruct on NVIDIA NIM: token pricing, context window, capabilities, modalities, and routing details in the Everstack model catalog.

Get Started with $5 Credits Read the docs

Llama 3.3 70B Instruct pricing and limits on NVIDIA NIM

Token pricing through NVIDIA NIM: $0.000 per million input tokens, $0.000 per million output tokens. Limits: 128K token context window, 4K max output tokens.

Capabilities and modalities

Supported capabilities: chat, function_calling. Accepts text input. Returns text output. Model family: llama. Catalog status: stable.

Routing Llama 3.3 70B Instruct through Everstack

Call Llama 3.3 70B Instruct on NVIDIA NIM through one OpenAI-compatible endpoint, with provider fallback, semantic caching, per-tenant rate limits, and OpenTelemetry traces for latency, tokens, and cost.