42B MoE with 6.6B active.
Released
Aug 20, 2024
Context window
131K tokens
Max output
Not disclosed
Parameters
42B 6.6B active
Input price
Not disclosed
Output price
Not disclosed
Prices are first-party list prices in USD at the standard tier. Last verified Aug 20, 2026.
Pricing
No first-party API. This is an open-weights release you can run yourself.
Specifications
- Developer
- Microsoft
- Model type
- Text LLM
- Architecture
- MoE
- Parameters
- 42B (6.6B active)
- Input
- Text
- Output
- Text
- Knowledge cutoff
- Not disclosed
- License
- MIT License
- API access
- No first-party API
- Capabilities
- Long context Small LM