RUN THIS LLM
Search local LLM hardware requirements
DeepSeek R1 Llama 8B
DeepSeek · 8B · Reasoning
R1 reasoning distilled into Llama 8B. Good balance of speed and reasoning quality.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 4.8 GB |
| Q8_0 (balanced) | 8.8 GB |
| FP16 (full quality) | 16 GB |
Specifications
- Parameters: 8B
- Category: Reasoning
- Max context: 128K tokens
- System RAM: 8 GB minimum
- HuggingFace: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
Benchmarks
- MMLU: 64 — General knowledge & reasoning (5-shot)
- MATH: 62 — Competition-level math reasoning
Loading interactive analysis...