Llama 4 Behemoth
by Meta
· Llama 4 family · released Apr 5, 2025
Open weights
Preview
Nearly 2T-param research preview, never broadly released.
This model has no first-party API. Open-weight release: self-host from published weights.
Specifications
| Model type | Multimodal |
|---|---|
| Architecture | MoE |
| Parameters | 2,000 (288 active) |
| Context window | 1.0M tokens |
| Max output | Not disclosed tokens |
| Knowledge cutoff | Not disclosed |
| License | Llama 3 Community License |
| Modalities | Text input Image input Text output |
| Tags | Flagship |
| End of life | Not disclosed |
| Last verified | Aug 20, 2026 |
Benchmarks
| Benchmark | Score | Src |
|---|---|---|
| MMLU | 82.2% | official |