RUN THIS LLM
Search local LLM hardware requirements
Aya 23 35B
Cohere · 35B · General
Leading open multilingual model supporting 23 languages. Built for non-English AI use cases.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 21 GB |
| Q8_0 (balanced) | 38.5 GB |
| FP16 (full quality) | 70 GB |
Specifications
- Parameters: 35B
- Category: General
- Max context: 32K tokens
- System RAM: 32 GB minimum
- HuggingFace: CohereLabs/aya-23-35B
Benchmarks
- MMLU: 72 — General knowledge & reasoning (5-shot)
Loading interactive analysis...