Llama 3.1 8B Instruct

Input / 1M: $0.231
Output / 1M: $0.231
Context: 128,000 tokens
Catalog: Gateway catalog

About this model

An update to Meta Llama 3 8B Instruct that includes an expanded 128K context length, multilinguality and improved reasoning capabilities. MiniRouter supports text input only.

text inputtext outputlanguage

Use with MiniRouter Compare this model View docs

Use an endpoint supported by this model.

Get a key for this setup →

1const response = await fetch('https://api.minirouter.sh/v1/chat/completions', {2  method: 'POST',3  headers: {4    Authorization: `Bearer ${process.env.MINIROUTER_KEY}`,5    'Content-Type': 'application/json',6  },7  body: JSON.stringify({8    model: 'meta/llama-3.1-8b',9    messages: [{ role: 'user', content: 'Why is the sky blue?' }],10    max_tokens: 1024,11  }),12})13 14const data = await response.json()15console.log(data.choices[0].message.content)

Read docs →

Overview

Model type: language
Context window: 128,000
Maximum output: 8,192
Input / 1M tokens: $0.231
Output / 1M tokens: $0.231
Released: 2024-07-23

Prices include the MiniRouter fee. Compatibility snapshot: 2026-08-06. Input: text. Output: text.

Endpoints

/v1/chat/completions/v1/messages/v1/responses

Platform-funded routing only. Caller BYOK credentials and OIDC-based upstream authentication are intentionally excluded; authenticate with a MiniRouter bearer key.

Captured parameters: max_tokens, temperature, stop, tools, tool_choice, reasoning, include_reasoning.

Structured output: Not enforced; a requested format is dropped and the answer is plain text. How it works

API

Use the setup panel above to switch between Chat Completions, Messages, and client configurations. Every snippet keeps the model ID unchanged.

Base URLhttps://api.minirouter.sh/v1

Model IDmeta/llama-3.1-8b

Providers

MiniRouter selects from the configured routes below. Priority is the catalog order, not a latency or availability score.

Provider	Priority	Input / 1M	Output / 1M	Parameters	Access
vercel	1	$0.231	$0.231	max_tokens, temperature, stop, tools, tool_choice, reasoning, include_reasoning	MiniRouter balance