RUN THIS LLM
Search local LLM hardware requirements
ERNIE 4.5 21B MoE Thinking
Baidu · 21B MoE · Reasoning
Baidu's lightweight thinking MoE: 21B total, 3B active per token, with 128K context and function calling. Post-trained for deeper reasoning on math, science, and code; Apache 2.0.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 12.6 GB |
| Q8_0 (balanced) | 23.1 GB |
| FP16 (full quality) | 42 GB |
Specifications
- Parameters: 21B MoE (3B active per token)
- Category: Reasoning
- Max context: 128K tokens
- System RAM: 16 GB minimum
- HuggingFace: baidu/ERNIE-4.5-21B-A3B-Thinking
Loading interactive analysis...