RUN THIS LLM
Search local LLM hardware requirements
Aya Expanse 32B
Cohere · 32B · General
32B multilingual model covering 23 languages. The strongest open multilingual model of its size at release. 128K context.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 19.2 GB |
| Q8_0 (balanced) | 35.2 GB |
| FP16 (full quality) | 64 GB |
Specifications
- Parameters: 32B
- Category: General
- Max context: 128K tokens
- System RAM: 32 GB minimum
- HuggingFace: CohereLabs/aya-expanse-32b
Loading interactive analysis...