RUN THIS LLM
Search local LLM hardware requirements
Command R+ 104B
Cohere · 104B · General
Cohere's large model. Top-tier for enterprise RAG, search, and agentic workflows.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 62.4 GB |
| Q8_0 (balanced) | 114.4 GB |
| FP16 (full quality) | 208 GB |
Specifications
- Parameters: 104B
- Category: General
- Max context: 128K tokens
- System RAM: 64 GB minimum
- HuggingFace: CohereForAI/c4ai-command-r-plus-08-2024
Benchmarks
- MMLU: 80 — General knowledge & reasoning (5-shot)
Loading interactive analysis...