Meta · Released Jul 23, 2024
Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
- Released
- Jul 23 2024
- Context window
- 131K 16K out
- Input / 1M tokens
- $0.40
- Output / 1M tokens
- $0.40
Where to run it
2 providers compared
Cheapest: DeepInfra at $0.40 / $0.40 per 1M input / output tokens — 44% less than the priciest option.
| Provider | Input | Output | Context | Max output | Uptime | vs. best |
|---|---|---|---|---|---|---|
| DeepInfraFP8 | $0.40 | $0.40 | 131K | 16K | 98.9%24h | Cheapest |
| Amazon Bedrockno tool calling | $0.72 | $0.72 | 131K | 8K | 100%24h | +80% |
Value
Price vs. performance
Llama 3.1 70B Instruct Other Meta Other labs Value frontier · GPQA Diamond vs. input price per 1M tokens (log scale) · Drag to pan, pinch or Ctrl + scroll to zoom, double-click to zoom in.
Benchmarks
3 benchmark scores
| Benchmark | Score | Rank | Leader |
|---|---|---|---|
| GPQA DiamondReasoning & knowledge · PhD-level biology, chemistry and physics questions | 44.2% | #110of 122 | Gemini 4 Argon96.4% |
| LMCAReasoning & knowledge · Judge the quality of conceptual arguments like experts | 14.8% | #110of 123 | Claude Sonnet 5.568.3% |
| OTIS Mock AIMEMaths · Competition-style problems harder than MATH Level 5 | 3.6% | #114of 120 | Gemini 4 Argon100.0% |
Specs
Details
- Model ID
meta-llama/llama-3.1-70b-instruct- Developer
- Meta
- Release date
- Jul 23, 2024 ·
- Context window
- 131,072 tokens
- Max output
- 16,384 tokens
- API price
- $0.40 / $0.40 per 1M input / output tokens
- Providers
- 2
- Input types
- text
- Reasoning
- No
- Tool calling
- Yes
- Open weights
- Yes
- Free tier
- No
Release date, prices and providers from OpenRouter's catalog; buying directly from a provider can cost a little differently. Uptime is the share of OpenRouter requests each provider served over the last day. Benchmark scores are the best result per benchmark from Epoch AI, licensed CC BY 4.0. Rank counts every model tracked here with a score.