GPT-J 6B
by EleutherAI
· GPT J family · released May 4, 2021
Open weights
Active
Classic open 6B from the GPT-3 paper era.
This model has no first-party API. Open-weight release: self-host from published weights.
Specifications
| Model type | Text LLM |
|---|---|
| Architecture | Dense |
| Parameters | 6 |
| Context window | 2.0K tokens |
| Max output | Not disclosed tokens |
| Knowledge cutoff | Apr 1, 2021 |
| License | Apache License 2.0 |
| Modalities | Text input Text output |
| Tags | Small LM |
| End of life | Not disclosed |
| Last verified | Aug 20, 2026 |
Benchmarks
| Benchmark | Score | Src |
|---|---|---|
| MMLU | 27.7% | - |