MMeta · Released Jul 23, 2024
Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
- Released
- Jul 23 2024
- Context window
- 131K 118K out
- Input / 1M tokens
- $0.05 from $0.02
- Output / 1M tokens
- $0.08 from $0.04
Where to run it
5 providers compared
Cheapest: DeepInfra at $0.02 / $0.04 per 1M input / output tokens — 89% less than the priciest option.
| Provider | Input | Output | Cache read | Context | Max output | Uptime | vs. best |
|---|---|---|---|---|---|---|---|
| DeepInfraFP8 · no tool calling | $0.02 | $0.04 | — | 131K | 16K | 99.9%24h | Cheapest |
| NovitaFP8 · no tool calling | $0.02 | $0.05 | — | 16K | 15K | 99%24h | +10% |
| Groq | $0.05 | $0.08 | $0.025 | 131K | 118K | 100%24h | +130% |
| CloudflareFP8 · no tool calling | $0.15 | $0.29 | — | 32K | 29K | 99.9%24h | +643% |
| CoreWeaveBF16 | $0.22 | $0.22 | $0.22 | 131K | 118K | 100%24h | +780% |
Value
Price vs. performance
Llama 3.1 8B Instruct Other Meta Other labs Value frontier · GPQA Diamond vs. input price per 1M tokens (log scale) · Drag to pan, pinch or Ctrl + scroll to zoom, double-click to zoom in.
Benchmarks
5 benchmark scores
| Benchmark | Score | Rank | Leader |
|---|---|---|---|
| SciCodeSoftware engineering · Research-coding problems from the natural sciences | 13.2% | #102of 102 | Claude Opus 5.566.9% |
| GPQA DiamondReasoning & knowledge · PhD-level biology, chemistry and physics questions | 27.0% | #119of 122 | Gemini 4 Argon96.4% |
| CritPtReasoning & knowledge · Open-ended, research-level physics problems | 0.0% | #92of 111 | GPT-5.6 Sol32.3% |
| LMCAReasoning & knowledge · Judge the quality of conceptual arguments like experts | 5.4% | #121of 123 | Claude Sonnet 5.568.3% |
| OTIS Mock AIMEMaths · Competition-style problems harder than MATH Level 5 | 1.7% | #117of 120 | Gemini 4 Argon100.0% |
Specs
Details
- Model ID
meta-llama/llama-3.1-8b-instruct- Developer
- Meta
- Release date
- Jul 23, 2024 ·
- Context window
- 131,072 tokens
- Max output
- 117,964 tokens
- API price
- $0.05 / $0.08 per 1M input / output tokens
- Providers
- 5
- Input types
- text
- Reasoning
- No
- Tool calling
- Yes
- Open weights
- Yes
- Free tier
- No
Release date, prices and providers from OpenRouter's catalog; buying directly from a provider can cost a little differently. Uptime is the share of OpenRouter requests each provider served over the last day. Benchmark scores are the best result per benchmark from Epoch AI, licensed CC BY 4.0. Rank counts every model tracked here with a score.