Open-source AI infrastructure

Llama 3.1 8B Instant

Review Llama 3.1 8B Instant on Groq: token pricing, context window, capabilities, modalities, and routing details in the Everstack model catalog.

Get Started with $5 Credits Read the docs

Llama 3.1 8B Instant pricing and limits on Groq

Token pricing through Groq: $0.050 per million input tokens, $0.080 per million output tokens. Limits: 131K token context window, 131K max output tokens.

Capabilities and modalities

Supported capabilities: chat, function_calling. Accepts text input. Returns text output. Model family: llama. Catalog status: stable.

Routing Llama 3.1 8B Instant through Everstack

Call Llama 3.1 8B Instant on Groq through one OpenAI-compatible endpoint, with provider fallback, semantic caching, per-tenant rate limits, and OpenTelemetry traces for latency, tokens, and cost.