Phi-3.5-MoE
by Microsoft
· PHI 3.5 family · released Aug 20, 2024
Open weights
Active
42B MoE with 6.6B active.
This model has no first-party API. Open-weight release: self-host from published weights.
Specifications
| Model type | Text LLM |
|---|---|
| Architecture | MoE |
| Parameters | 42 (6.6 active) |
| Context window | 131.1K tokens |
| Max output | Not disclosed tokens |
| Knowledge cutoff | Not disclosed |
| License | MIT License |
| Modalities | Text input Text output |
| Tags | Long context Small LM |
| End of life | Not disclosed |
| Last verified | Aug 20, 2026 |