Phi-3.5-MoE

Open weights Active Text LLM MoE phi-3-5-moe

42B MoE with 6.6B active.

Released
Aug 20, 2024
Context window
131K tokens
Max output
Not disclosed
Parameters
42B 6.6B active
Input price
Not disclosed
Output price
Not disclosed

Prices are first-party list prices in USD at the standard tier. Last verified Aug 20, 2026.

Pricing

No first-party API. This is an open-weights release you can run yourself.

Specifications

Developer
Microsoft
Model type
Text LLM
Architecture
MoE
Parameters
42B (6.6B active)
Input
Text
Output
Text
Knowledge cutoff
Not disclosed
License
MIT License
API access
No first-party API
Capabilities
Long context Small LM