Efficient open MoE beating Grok-1 and Mixtral.
Released
Mar 27, 2024
Context window
32.8K tokens
Max output
Not disclosed
Parameters
132B 36B active
Input price
$0.75 per 1M
Output price
$2.25 per 1M
Prices are first-party list prices in USD at the standard tier. Last verified Aug 20, 2026.
Pricing
Launch priceMar 27, 2024
$0.75 in / $2.25 out
Current price
since Mar 27, 2024
$0.75 in / $2.25 out
Specifications
- Developer
- Databricks
- Model type
- Text LLM
- Architecture
- MoE
- Parameters
- 132B (36B active)
- Input
- Text
- Output
- Text
- Knowledge cutoff
- Not disclosed
- License
- Databricks Open Model License
- API access
- No first-party API
- Capabilities
- Coding