RUN THIS LLM
Search local LLM hardware requirements
Hermes 3 70B
Nous · 70B · General
Large Hermes model. Top-tier for agentic tasks, tool use, and structured generation.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 42 GB |
| Q8_0 (balanced) | 77 GB |
| FP16 (full quality) | 140 GB |
Specifications
- Parameters: 70B
- Category: General
- Max context: 128K tokens
- System RAM: 48 GB minimum
- HuggingFace: NousResearch/Hermes-3-Llama-3.1-70B
Benchmarks
- MMLU: 84 — General knowledge & reasoning (5-shot)
Loading interactive analysis...