GPT-NeoX-20B

by EleutherAI · GPT Neox family · released Feb 8, 2022
Open weights Active

20B open base pre-GPT-4.

This model has no first-party API. Open-weight release: self-host from published weights.

Specifications

Model typeText LLM
ArchitectureDense
Parameters20
Context window2.0K tokens
Max outputNot disclosed tokens
Knowledge cutoffSep 1, 2021
LicenseApache License 2.0
Modalities Text input Text output
Tags -
End of lifeNot disclosed
Last verifiedAug 20, 2026