Llama 3.1 8B Instruct

An update to Meta Llama 3 8B Instruct that includes an expanded 128K context length, multilinguality and improved reasoning capabilities.

text inputtext outputlanguage

Use with MiniRouter View docs

1const response = await fetch('https://api.minirouter.sh/v1/chat/completions', {2  method: 'POST',3  headers: {4    Authorization: `Bearer ${process.env.MINIROUTER_KEY}`,5    'Content-Type': 'application/json',6  },7  body: JSON.stringify({8    model: 'meta/llama-3.1-8b',9    messages: [{ role: 'user', content: 'Why is the sky blue?' }],10  }),11})12 13const data = await response.json()14console.log(data.choices[0].message.content)

Read docs →

Overview

Model type: language
Context window: 128,000
Maximum output: 8,192
Input / 1M tokens: $0.231
Output / 1M tokens: $0.231
Released: 2024-07-23

Prices include the MiniRouter fee. Compatibility snapshot: 2026-08-06. Input: text. Output: text.

Endpoints

/v1/chat/completions/v1/messages/v1/responses

Platform-funded routing only. Caller BYOK credentials and OIDC-based upstream authentication are intentionally excluded; authenticate with a MiniRouter bearer key.

Captured parameters: max_tokens, temperature, stop, tools, tool_choice.

API

Use the setup panel above to switch between Chat Completions, Messages, and client configurations. Every snippet keeps the model ID unchanged.

Base URLhttps://api.minirouter.sh/v1

Model IDmeta/llama-3.1-8b

Providers

MiniRouter selects from the configured routes below. Priority is the catalog order, not a latency or availability score.

Provider	Priority	Input / 1M	Output / 1M	Parameters	Access
vercel	1	$0.231	$0.231	max_tokens, temperature, stop, tools, tool_choice	MiniRouter balance