MPT-7B
by Databricks
· Mpt family · released May 5, 2023
Open weights
Active
Commercial-friendly 7B base with ALiBi.
This model has no first-party API. Open-weight release: self-host from published weights.
Specifications
| Model type | Text LLM |
|---|---|
| Architecture | Dense |
| Parameters | 7 |
| Context window | 8.2K tokens |
| Max output | Not disclosed tokens |
| Knowledge cutoff | Not disclosed |
| License | Apache License 2.0 |
| Modalities | Text input Text output |
| Tags | Small LM |
| End of life | Not disclosed |
| Last verified | Aug 20, 2026 |