RUN THIS LLM
Search local LLM hardware requirements
Falcon 40B
TII · 40B · General
TII's large open model. Trained on massive web data with strong general knowledge.
VRAM Requirements
| Quantization | VRAM |
|---|---|
| Q4_K_M (smallest) | 24 GB |
| Q8_0 (balanced) | 44 GB |
| FP16 (full quality) | 80 GB |
Specifications
- Parameters: 40B
- Category: General
- Max context: 2K tokens
- System RAM: 40 GB minimum
- HuggingFace: tiiuae/falcon-40b-instruct
Benchmarks
- MMLU: 57 — General knowledge & reasoning (5-shot)
Loading interactive analysis...