RUN THIS LLM
Search local LLM hardware requirements
Aya Expanse 8B
Cohere · 8B · General
Successor to Aya 23 — 8B multilingual model covering 23 languages with markedly better win rates than same-size peers.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 4.8 GB |
| Q8_0 (balanced) | 8.8 GB |
| FP16 (full quality) | 16 GB |
Specifications
- Parameters: 8B
- Category: General
- Max context: 8K tokens
- System RAM: 8 GB minimum
- HuggingFace: CohereLabs/aya-expanse-8b
Loading interactive analysis...