Open-source AI infrastructure

Llama 3.1 70B Instruct on Vertex AI

Review Llama 3.1 70B Instruct on Vertex AI: token pricing, context window, capabilities, modalities, and routing details in the Everstack model catalog.

Get Started with $5 Credits Read the docs

Llama 3.1 70B Instruct pricing and limits on Vertex AI

Token pricing through Vertex AI: $0.900 per million input tokens, $0.900 per million output tokens. Limits: 131K token context window, 8K max output tokens.

Capabilities and modalities

Supported capabilities: chat, function_calling. Accepts text input. Returns text output. Model family: llama. Catalog status: stable.

Routing Llama 3.1 70B Instruct through Everstack

Call Llama 3.1 70B Instruct on Vertex AI through one OpenAI-compatible endpoint, with provider fallback, semantic caching, per-tenant rate limits, and OpenTelemetry traces for latency, tokens, and cost.