Llama 4 Behemoth

by Meta · Llama 4 family · released Apr 5, 2025
Open weights Preview

Nearly 2T-param research preview, never broadly released.

This model has no first-party API. Open-weight release: self-host from published weights.

Specifications

Model typeMultimodal
ArchitectureMoE
Parameters2,000 (288 active)
Context window1.0M tokens
Max outputNot disclosed tokens
Knowledge cutoffNot disclosed
LicenseLlama 3 Community License
Modalities Text input Image input Text output
Tags Flagship
End of lifeNot disclosed
Last verifiedAug 20, 2026

Benchmarks

BenchmarkScoreSrc
MMLU 82.2% official

Family versions