Pythia 12B
by EleutherAI
· Pythia family · released Feb 13, 2023
Open weights
Active
Interpretability research suite flagship.
This model has no first-party API. Open-weight release: self-host from published weights.
Specifications
| Model type | Text LLM |
|---|---|
| Architecture | Dense |
| Parameters | 12 |
| Context window | 2.0K tokens |
| Max output | Not disclosed tokens |
| Knowledge cutoff | Not disclosed |
| License | Apache License 2.0 |
| Modalities | Text input Text output |
| Tags | - |
| End of life | Not disclosed |
| Last verified | Aug 20, 2026 |